Apr 17 10:30:06 user nova-compute[82522]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 17 10:30:08 user nova-compute[82522]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=82522) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 17 10:30:08 user nova-compute[82522]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=82522) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 17 10:30:08 user nova-compute[82522]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=82522) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 17 10:30:08 user nova-compute[82522]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:30:09 user nova-compute[82522]: INFO nova.virt.driver [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 17 10:30:09 user nova-compute[82522]: INFO nova.compute.provider_config [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] Acquiring lock "singleton_lock" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] Acquired lock "singleton_lock" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] Releasing lock "singleton_lock" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] Full set of CONF: {{(pid=82522) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ******************************************************************************** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] Configuration options gathered from: {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ================================================================================ {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] allow_resize_to_same_host      = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] arq_binding_timeout            = 300 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] backdoor_port                  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] backdoor_socket                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] block_device_allocate_retries  = 300 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] block_device_allocate_retries_interval = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cert                           = self.pem {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute_monitors               = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] config_dir                     = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] config_drive_format            = iso9660 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] config_source                  = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] console_host                   = user {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] control_exchange               = nova {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cpu_allocation_ratio           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] daemon                         = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] debug                          = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] default_access_ip_network_name = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] default_availability_zone      = nova {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] default_ephemeral_format       = ext4 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] default_schedule_zone          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] disk_allocation_ratio          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] enable_new_services            = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] enabled_apis                   = ['osapi_compute'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] enabled_ssl_apis               = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] flat_injected                  = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] force_config_drive             = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] force_raw_images               = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] graceful_shutdown_timeout      = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] heal_instance_info_cache_interval = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] host                           = user {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] instance_build_timeout         = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] instance_delete_interval       = 300 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] instance_name_template         = instance-%08x {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] instance_usage_audit           = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] instance_usage_audit_period    = month {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] internal_service_availability_zone = internal {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] key                            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] live_migration_retry_count     = 30 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] log_config_append              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] log_dir                        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] log_file                       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] log_options                    = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] log_rotate_interval            = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] log_rotate_interval_type       = days {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] log_rotation_type              = none {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] long_rpc_timeout               = 1800 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] max_concurrent_builds          = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] max_concurrent_live_migrations = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] max_concurrent_snapshots       = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] max_local_block_devices        = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] max_logfile_count              = 30 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] max_logfile_size_mb            = 200 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] maximum_instance_delete_attempts = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] metadata_listen                = 0.0.0.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] metadata_listen_port           = 8775 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] metadata_workers               = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] migrate_max_retries            = -1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] mkisofs_cmd                    = genisoimage {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] my_ip                          = 10.0.0.210 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] network_allocate_retries       = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] osapi_compute_listen_port      = 8774 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] osapi_compute_unique_server_name_scope =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] osapi_compute_workers          = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] password_length                = 12 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] periodic_enable                = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] periodic_fuzzy_delay           = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] pointer_model                  = ps2mouse {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] preallocate_images             = none {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] publish_errors                 = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] pybasedir                      = /opt/stack/nova {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ram_allocation_ratio           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] rate_limit_burst               = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] rate_limit_except_level        = CRITICAL {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] rate_limit_interval            = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] reboot_timeout                 = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] reclaim_instance_interval      = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] record                         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] reimage_timeout_per_gb         = 20 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] report_interval                = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] rescue_timeout                 = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] reserved_host_cpus             = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] reserved_host_disk_mb          = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] reserved_host_memory_mb        = 512 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] reserved_huge_pages            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] resize_confirm_window          = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] resize_fs_using_block_device   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] resume_guests_state_on_host_boot = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] rpc_response_timeout           = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] run_external_periodic_tasks    = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] running_deleted_instance_action = reap {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] running_deleted_instance_timeout = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler_instance_sync_interval = 120 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_down_time              = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] servicegroup_driver            = db {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] shelved_offload_time           = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] shelved_poll_interval          = 3600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] shutdown_timeout               = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] source_is_ipv6                 = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ssl_only                       = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] state_path                     = /opt/stack/data/nova {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] sync_power_state_interval      = 600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] sync_power_state_pool_size     = 1000 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] syslog_log_facility            = LOG_USER {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] tempdir                        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] timeout_nbd                    = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] transport_url                  = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] update_resources_interval      = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] use_cow_images                 = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] use_eventlog                   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] use_journal                    = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] use_json                       = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] use_rootwrap_daemon            = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] use_stderr                     = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] use_syslog                     = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vcpu_pin_set                   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plugging_is_fatal          = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plugging_timeout           = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] virt_mkfs                      = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] volume_usage_poll_interval     = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] watch_log_file                 = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] web                            = /usr/share/spice-html5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_concurrency.disable_process_locking = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.auth_strategy              = keystone {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.compute_link_prefix        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.dhcp_domain                = novalocal {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.enable_instance_password   = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.glance_link_prefix         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.instance_list_per_project_cells = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.list_records_by_skipping_down_cells = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.local_metadata_per_cell    = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.max_limit                  = 1000 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.metadata_cache_expiration  = 15 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.neutron_default_tenant_id  = default {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.use_forwarded_for          = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.use_neutron_default_nets   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.vendordata_dynamic_targets = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.vendordata_jsonfile_path   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.backend                  = dogpile.cache.memcached {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.backend_argument         = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.config_prefix            = cache.oslo {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.dead_timeout             = 60.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.debug_cache_backend      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.enable_retry_client      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.enable_socket_keepalive  = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.enabled                  = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.expiration_time          = 600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.hashclient_retry_attempts = 2 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_dead_retry      = 300 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_password        =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_sasl_enabled    = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.memcache_username        =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.proxies                  = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.retry_attempts           = 2 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.retry_delay              = 0.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.socket_keepalive_count   = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.socket_keepalive_idle    = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.socket_keepalive_interval = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.tls_allowed_ciphers      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.tls_cafile               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.tls_certfile             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.tls_enabled              = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cache.tls_keyfile              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.auth_section            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.auth_type               = password {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.cafile                  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.certfile                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.collect_timing          = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.cross_az_attach         = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.debug                   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.endpoint_template       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.http_retries            = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.insecure                = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.keyfile                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.os_region_name          = RegionOne {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.split_loggers           = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cinder.timeout                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.cpu_dedicated_set      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.cpu_shared_set         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.image_type_exclude_list = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.resource_provider_association_refresh = 300 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.shutdown_retry_interval = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] conductor.workers              = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] console.allowed_origins        = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] console.ssl_ciphers            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] console.ssl_minimum_version    = default {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] consoleauth.token_ttl          = 600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.cafile                  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.certfile                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.collect_timing          = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.connect_retries         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.connect_retry_delay     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.endpoint_override       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.insecure                = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.keyfile                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.max_version             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.min_version             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.region_name             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.service_name            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.service_type            = accelerator {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.split_loggers           = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.status_code_retries     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.status_code_retry_delay = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.timeout                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] cyborg.version                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.backend               = sqlalchemy {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.connection            = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.connection_debug      = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.connection_parameters =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.connection_recycle_time = 3600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.connection_trace      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.db_inc_retry_interval = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.db_max_retries        = 20 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.db_max_retry_interval = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.db_retry_interval     = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.max_overflow          = 50 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.max_pool_size         = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.max_retries           = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.mysql_enable_ndb      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.mysql_wsrep_sync_wait = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.pool_timeout          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.retry_interval        = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.slave_connection      = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] database.sqlite_synchronous    = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.backend           = sqlalchemy {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.connection        = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.connection_debug  = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.connection_parameters =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.connection_recycle_time = 3600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.connection_trace  = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.db_inc_retry_interval = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.db_max_retries    = 20 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.db_max_retry_interval = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.db_retry_interval = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.max_overflow      = 50 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.max_pool_size     = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.max_retries       = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.mysql_enable_ndb  = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.pool_timeout      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.retry_interval    = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.slave_connection  = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] api_database.sqlite_synchronous = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] devices.enabled_mdev_types     = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ephemeral_storage_encryption.enabled = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.api_servers             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.cafile                  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.certfile                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.collect_timing          = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.connect_retries         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.connect_retry_delay     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.debug                   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.default_trusted_certificate_ids = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.enable_certificate_validation = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.enable_rbd_download     = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.endpoint_override       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.insecure                = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.keyfile                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.max_version             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.min_version             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.num_retries             = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.rbd_ceph_conf           =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.rbd_connect_timeout     = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.rbd_pool                =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.rbd_user                =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.region_name             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.service_name            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.service_type            = image {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.split_loggers           = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.status_code_retries     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.status_code_retry_delay = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.timeout                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.verify_glance_signatures = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] glance.version                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] guestfs.debug                  = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.config_drive_cdrom      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.config_drive_inject_password = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.enable_instance_metrics_collection = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.enable_remotefx         = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.instances_path_share    =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.iscsi_initiator_list    = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.limit_cpu_features      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.power_state_check_timeframe = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.use_multipath_io        = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.volume_attach_retry_count = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.vswitch_name            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] mks.enabled                    = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] image_cache.manager_interval   = 2400 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] image_cache.precache_concurrency = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] image_cache.remove_unused_base_images = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] image_cache.subdirectory_name  = _base {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.api_max_retries         = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.api_retry_interval      = 2 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.auth_section            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.auth_type               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.cafile                  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.certfile                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.collect_timing          = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.connect_retries         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.connect_retry_delay     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.endpoint_override       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.insecure                = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.keyfile                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.max_version             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.min_version             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.partition_key           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.peer_list               = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.region_name             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.serial_console_state_timeout = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.service_name            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.service_type            = baremetal {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.split_loggers           = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.status_code_retries     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.status_code_retry_delay = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.timeout                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ironic.version                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] key_manager.fixed_key          = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.barbican_api_version  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.barbican_endpoint     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.barbican_endpoint_type = public {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.barbican_region_name  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.cafile                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.certfile              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.collect_timing        = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.insecure              = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.keyfile               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.number_of_retries     = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.retry_delay           = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.send_service_user_token = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.split_loggers         = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.timeout               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.verify_ssl            = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican.verify_ssl_path       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican_service_user.auth_section = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican_service_user.auth_type = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican_service_user.cafile   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican_service_user.certfile = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican_service_user.collect_timing = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican_service_user.insecure = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican_service_user.keyfile  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican_service_user.split_loggers = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] barbican_service_user.timeout  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.approle_role_id          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.approle_secret_id        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.cafile                   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.certfile                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.collect_timing           = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.insecure                 = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.keyfile                  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.kv_mountpoint            = secret {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.kv_version               = 2 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.namespace                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.root_token_id            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.split_loggers            = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.ssl_ca_crt_file          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.timeout                  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.use_ssl                  = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.cafile                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.certfile              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.collect_timing        = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.connect_retries       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.connect_retry_delay   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.endpoint_override     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.insecure              = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.keyfile               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.max_version           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.min_version           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.region_name           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.service_name          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.service_type          = identity {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.split_loggers         = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.status_code_retries   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.status_code_retry_delay = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.timeout               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] keystone.version               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.connection_uri         =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.cpu_mode               = custom {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: WARNING oslo_config.cfg [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.cpu_power_governor_high = performance {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.cpu_power_governor_low = powersave {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.cpu_power_management   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.device_detach_attempts = 8 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.device_detach_timeout  = 20 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.disk_cachemodes        = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.disk_prefix            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.enabled_perf_events    = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.file_backed_memory     = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.gid_maps               = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.hw_disk_discard        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.hw_machine_type        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.images_rbd_glance_store_name =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.images_rbd_pool        = rbd {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.images_type            = default {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.images_volume_group    = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.inject_key             = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.inject_partition       = -2 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.inject_password        = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.iscsi_iface            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.iser_use_multipath     = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_downtime = 500 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_inbound_addr = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_scheme  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_timeout_action = abort {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_tunnelled = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: WARNING oslo_config.cfg [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 17 10:30:09 user nova-compute[82522]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 17 10:30:09 user nova-compute[82522]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 17 10:30:09 user nova-compute[82522]: and ``live_migration_inbound_addr`` respectively.
Apr 17 10:30:09 user nova-compute[82522]: ).  Its value may be silently ignored in the future.
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.live_migration_with_native_tls = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.max_queues             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.nfs_mount_options      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.num_pcie_ports         = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.pmem_namespaces        = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.quobyte_client_cfg     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rbd_secret_uuid        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rbd_user               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rescue_image_id        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rescue_kernel_id       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rescue_ramdisk_id      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.rx_queue_size          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.smbfs_mount_options    =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.snapshot_compression   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.snapshot_image_format  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.sparse_logical_volumes = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.swtpm_enabled          = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.swtpm_group            = tss {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.swtpm_user             = tss {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.sysinfo_serial         = unique {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.tx_queue_size          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.uid_maps               = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.use_virtio_for_bridges = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.virt_type              = kvm {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.volume_clear           = zero {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.volume_clear_size      = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.volume_use_multipath   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.vzstorage_cache_path   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.vzstorage_mount_user   = stack {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.auth_section           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.auth_type              = password {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.cafile                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.certfile               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.collect_timing         = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.connect_retries        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.connect_retry_delay    = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.default_floating_pool  = public {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.endpoint_override      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.extension_sync_interval = 600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.http_retries           = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.insecure               = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.keyfile                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.max_version            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.min_version            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.ovs_bridge             = br-int {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.physnets               = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.region_name            = RegionOne {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.service_metadata_proxy = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.service_name           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.service_type           = network {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.split_loggers          = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.status_code_retries    = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.status_code_retry_delay = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.timeout                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] neutron.version                = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] notifications.bdms_in_notifications = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] notifications.default_level    = INFO {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] notifications.notification_format = unversioned {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] notifications.notify_on_state_change = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] pci.alias                      = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] pci.device_spec                = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] pci.report_in_placement        = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.auth_section         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.auth_type            = password {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.cafile               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.certfile             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.collect_timing       = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.connect_retries      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.connect_retry_delay  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.default_domain_id    = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.default_domain_name  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.domain_id            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.domain_name          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.endpoint_override    = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.insecure             = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.keyfile              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.max_version          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.min_version          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.password             = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.project_domain_id    = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.project_domain_name  = Default {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.project_id           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.project_name         = service {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.region_name          = RegionOne {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.service_name         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.service_type         = placement {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.split_loggers        = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.status_code_retries  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.status_code_retry_delay = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.system_scope         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.timeout              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.trust_id             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.user_domain_id       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.user_domain_name     = Default {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.user_id              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.username             = placement {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] placement.version              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.cores                    = 20 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.count_usage_from_placement = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.injected_file_content_bytes = 10240 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.injected_file_path_length = 255 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.injected_files           = 5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.instances                = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.key_pairs                = 100 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.metadata_items           = 128 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.ram                      = 51200 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.recheck_quota            = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.server_group_members     = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] quota.server_groups            = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] rdp.enabled                    = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.image_metadata_prefilter = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.max_attempts         = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.max_placement_results = 1000 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.query_placement_for_availability_zone = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] scheduler.workers              = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.host_subset_size = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.isolated_hosts = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.isolated_images = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.pci_in_placement = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.track_instance_changes = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] metrics.required               = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] metrics.weight_multiplier      = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] metrics.weight_setting         = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] serial_console.enabled         = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] serial_console.port_range      = 10000:20000 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] serial_console.serialproxy_port = 6083 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.auth_section      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.auth_type         = password {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.cafile            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.certfile          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.collect_timing    = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.insecure          = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.keyfile           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.send_service_user_token = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.split_loggers     = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] service_user.timeout           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.agent_enabled            = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.enabled                  = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.html5proxy_port          = 6082 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.image_compression        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.jpeg_compression         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.playback_compression     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.server_listen            = 127.0.0.1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.streaming_mode           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] spice.zlib_compression         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] upgrade_levels.baseapi         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] upgrade_levels.cert            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] upgrade_levels.compute         = auto {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] upgrade_levels.conductor       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] upgrade_levels.scheduler       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vendordata_dynamic_auth.cafile = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vendordata_dynamic_auth.certfile = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vendordata_dynamic_auth.insecure = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vendordata_dynamic_auth.timeout = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.api_retry_count         = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.ca_file                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.cache_prefix            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.cluster_name            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.connection_pool_size    = 10 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.console_delay_seconds   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.datastore_regex         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.host_ip                 = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.host_password           = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.host_port               = 443 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.host_username           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.insecure                = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.integration_bridge      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.maximum_objects         = 100 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.pbm_default_policy      = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.pbm_enabled             = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.pbm_wsdl_location       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.serial_port_proxy_uri   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.serial_port_service_uri = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.task_poll_interval      = 0.5 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.use_linked_clone        = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.vnc_keymap              = en-us {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.vnc_port                = 5900 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vmware.vnc_port_total          = 10000 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.auth_schemes               = ['none'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.enabled                    = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.novncproxy_port            = 6080 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.server_listen              = 0.0.0.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.vencrypt_ca_certs          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.vencrypt_client_cert       = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vnc.vencrypt_client_key        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.disable_rootwrap   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.enable_numa_live_migration = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.libvirt_disable_apic = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.client_socket_timeout     = 900 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.default_pool_size         = 1000 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.keep_alive                = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.max_header_line           = 16384 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.ssl_ca_file               = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.ssl_cert_file             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.ssl_key_file              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.tcp_keepidle              = 600 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] zvm.ca_file                    = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] zvm.cloud_connector_url        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] zvm.reachable_timeout          = 300 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.enforce_new_defaults = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.enforce_scope      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.policy_default_rule = default {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.connection_string     = messaging:// {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.enabled               = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.es_doc_type           = notification {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.es_scroll_size        = 10000 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.es_scroll_time        = 2m {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.filter_error_trace    = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.sentinel_service_name = mymaster {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.socket_timeout        = 0.1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] profiler.trace_sqlalchemy      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] remote_debug.host              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] remote_debug.port              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_notifications.retry = -1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.auth_section        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.auth_type           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.cafile              = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.certfile            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.collect_timing      = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.connect_retries     = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.connect_retry_delay = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.endpoint_id         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.endpoint_override   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.insecure            = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.keyfile             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.max_version         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.min_version         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.region_name         = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.service_name        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.service_type        = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.split_loggers       = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.status_code_retries = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.status_code_retry_delay = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.timeout             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.valid_interfaces    = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_limit.version             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_reports.file_event_handler = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] oslo_reports.log_dir           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_ovs_privileged.group  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] vif_plug_ovs_privileged.user   = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_linux_bridge.flat_interface = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_ovs.isolate_vif         = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_vif_ovs.per_port_bridge     = False {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] os_brick.lock_path             = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] privsep_osbrick.capabilities   = [21] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] privsep_osbrick.group          = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] privsep_osbrick.helper_command = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] privsep_osbrick.user           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] nova_sys_admin.group           = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] nova_sys_admin.helper_command  = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] nova_sys_admin.user            = None {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG oslo_service.service [None req-68b549f0-d215-4d7d-8ef4-91f1501316a5 None None] ******************************************************************************** {{(pid=82522) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 17 10:30:09 user nova-compute[82522]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 17 10:30:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Starting native event thread {{(pid=82522) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Starting green dispatch thread {{(pid=82522) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Starting connection event dispatch thread {{(pid=82522) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Connecting to libvirt: qemu:///system {{(pid=82522) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa2affb65f0> {{(pid=82522) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 17 10:30:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa2affb65f0> {{(pid=82522) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 17 10:30:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Connection event '1' reason 'None'
Apr 17 10:30:09 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 17 10:30:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.mount [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Initialising _HostMountState generation 0 {{(pid=82522) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 17 10:30:17 user nova-compute[82522]: INFO nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt host capabilities <capabilities>
Apr 17 10:30:17 user nova-compute[82522]:   <host>
Apr 17 10:30:17 user nova-compute[82522]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 17 10:30:17 user nova-compute[82522]:     <cpu>
Apr 17 10:30:17 user nova-compute[82522]:       <arch>x86_64</arch>
Apr 17 10:30:17 user nova-compute[82522]:       <model>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <vendor>Intel</vendor>
Apr 17 10:30:17 user nova-compute[82522]:       <microcode version='1070'/>
Apr 17 10:30:17 user nova-compute[82522]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 17 10:30:17 user nova-compute[82522]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='ss'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='vmx'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='pcid'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='osxsave'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='hypervisor'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='arat'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='tsc_adjust'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='md-clear'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='arch-capabilities'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='invtsc'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='rsba'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature name='skip-l1dfl-vmentry'/>
Apr 17 10:30:17 user nova-compute[82522]:       <pages unit='KiB' size='4'/>
Apr 17 10:30:17 user nova-compute[82522]:       <pages unit='KiB' size='2048'/>
Apr 17 10:30:17 user nova-compute[82522]:     </cpu>
Apr 17 10:30:17 user nova-compute[82522]:     <power_management>
Apr 17 10:30:17 user nova-compute[82522]:       <suspend_mem/>
Apr 17 10:30:17 user nova-compute[82522]:       <suspend_disk/>
Apr 17 10:30:17 user nova-compute[82522]:       <suspend_hybrid/>
Apr 17 10:30:17 user nova-compute[82522]:     </power_management>
Apr 17 10:30:17 user nova-compute[82522]:     <iommu support='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     <migration_features>
Apr 17 10:30:17 user nova-compute[82522]:       <live/>
Apr 17 10:30:17 user nova-compute[82522]:       <uri_transports>
Apr 17 10:30:17 user nova-compute[82522]:         <uri_transport>tcp</uri_transport>
Apr 17 10:30:17 user nova-compute[82522]:         <uri_transport>rdma</uri_transport>
Apr 17 10:30:17 user nova-compute[82522]:       </uri_transports>
Apr 17 10:30:17 user nova-compute[82522]:     </migration_features>
Apr 17 10:30:17 user nova-compute[82522]:     <topology>
Apr 17 10:30:17 user nova-compute[82522]:       <cells num='2'>
Apr 17 10:30:17 user nova-compute[82522]:         <cell id='0'>
Apr 17 10:30:17 user nova-compute[82522]:           <memory unit='KiB'>8152920</memory>
Apr 17 10:30:17 user nova-compute[82522]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 17 10:30:17 user nova-compute[82522]:           <pages unit='KiB' size='2048'>0</pages>
Apr 17 10:30:17 user nova-compute[82522]:           <distances>
Apr 17 10:30:17 user nova-compute[82522]:             <sibling id='0' value='10'/>
Apr 17 10:30:17 user nova-compute[82522]:             <sibling id='1' value='20'/>
Apr 17 10:30:17 user nova-compute[82522]:           </distances>
Apr 17 10:30:17 user nova-compute[82522]:           <cpus num='6'>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 17 10:30:17 user nova-compute[82522]:           </cpus>
Apr 17 10:30:17 user nova-compute[82522]:         </cell>
Apr 17 10:30:17 user nova-compute[82522]:         <cell id='1'>
Apr 17 10:30:17 user nova-compute[82522]:           <memory unit='KiB'>8255068</memory>
Apr 17 10:30:17 user nova-compute[82522]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 17 10:30:17 user nova-compute[82522]:           <pages unit='KiB' size='2048'>0</pages>
Apr 17 10:30:17 user nova-compute[82522]:           <distances>
Apr 17 10:30:17 user nova-compute[82522]:             <sibling id='0' value='20'/>
Apr 17 10:30:17 user nova-compute[82522]:             <sibling id='1' value='10'/>
Apr 17 10:30:17 user nova-compute[82522]:           </distances>
Apr 17 10:30:17 user nova-compute[82522]:           <cpus num='6'>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 17 10:30:17 user nova-compute[82522]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 17 10:30:17 user nova-compute[82522]:           </cpus>
Apr 17 10:30:17 user nova-compute[82522]:         </cell>
Apr 17 10:30:17 user nova-compute[82522]:       </cells>
Apr 17 10:30:17 user nova-compute[82522]:     </topology>
Apr 17 10:30:17 user nova-compute[82522]:     <cache>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 17 10:30:17 user nova-compute[82522]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 17 10:30:17 user nova-compute[82522]:     </cache>
Apr 17 10:30:17 user nova-compute[82522]:     <secmodel>
Apr 17 10:30:17 user nova-compute[82522]:       <model>apparmor</model>
Apr 17 10:30:17 user nova-compute[82522]:       <doi>0</doi>
Apr 17 10:30:17 user nova-compute[82522]:     </secmodel>
Apr 17 10:30:17 user nova-compute[82522]:     <secmodel>
Apr 17 10:30:17 user nova-compute[82522]:       <model>dac</model>
Apr 17 10:30:17 user nova-compute[82522]:       <doi>0</doi>
Apr 17 10:30:17 user nova-compute[82522]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 17 10:30:17 user nova-compute[82522]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 17 10:30:17 user nova-compute[82522]:     </secmodel>
Apr 17 10:30:17 user nova-compute[82522]:   </host>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='alpha'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>clipper</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='armv6l'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>integratorcp</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>borzoi</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>spitz</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>nuri</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>musca-b1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>versatileab</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>kzm</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>musca-a</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>smdkc210</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sx1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>z2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>tosa</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>sabrelite</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>realview-eb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>n810</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>n800</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>versatilepb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>terrier</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mainstone</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>midway</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>musicpal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>microbit</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>cubieboard</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>verdex</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>netduino2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>raspi2b</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>cheetah</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>highbank</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>akita</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>connex</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>collie</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>raspi0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='armv7l'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>integratorcp</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>borzoi</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>spitz</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>nuri</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>musca-b1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>versatileab</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>kzm</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>musca-a</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>smdkc210</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sx1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>z2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>tosa</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>sabrelite</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>realview-eb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>n810</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>n800</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>versatilepb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>terrier</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mainstone</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>midway</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>musicpal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>microbit</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>cubieboard</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>verdex</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>netduino2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>raspi2b</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>cheetah</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>highbank</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>akita</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>connex</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>collie</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>raspi0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='aarch64'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>integratorcp</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>borzoi</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>spitz</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>nuri</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>musca-b1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>versatileab</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>kzm</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>musca-a</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>smdkc210</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sx1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>z2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>tosa</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>sabrelite</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>realview-eb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>n810</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>n800</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>versatilepb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>terrier</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mainstone</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>midway</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>musicpal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>microbit</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>cubieboard</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>verdex</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>netduino2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>raspi3b</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>raspi2b</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>cheetah</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>highbank</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>akita</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>connex</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>collie</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>raspi0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <acpi default='on' toggle='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='cris'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='i686'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>x-remote</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>isapc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>microvm</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='kvm'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <pae/>
Apr 17 10:30:17 user nova-compute[82522]:       <nonpae/>
Apr 17 10:30:17 user nova-compute[82522]:       <acpi default='on' toggle='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:       <apic default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='m68k'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>an5206</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>q800</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>next-cube</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='microblaze'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='microblazeel'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='mips'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='16'>malta</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mipssim</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='mipsel'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='16'>malta</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mipssim</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='mips64'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='16'>malta</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mipssim</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>pica61</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>magnum</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='mips64el'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='16'>malta</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mipssim</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>pica61</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>magnum</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='16'>boston</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='ppc'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>g3beige</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mac99</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>ppce500</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>pegasos2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sam460ex</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>bamboo</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>40p</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>ref405ep</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>taihu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='ppc64'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2048'>powernv9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>taihu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2048'>powernv10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>ppce500</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>40p</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>pegasos2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>bamboo</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>g3beige</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mac99</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sam460ex</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>ref405ep</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2048'>powernv8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='ppc64le'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2048'>powernv9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>taihu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2048'>powernv10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>ppce500</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>40p</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>pegasos2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>bamboo</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>g3beige</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>mac99</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sam460ex</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>ref405ep</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2048'>powernv8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='riscv32'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='8'>spike</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>opentitan</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='5'>sifive_u</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sifive_e</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='8'>virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='riscv64'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='8'>spike</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='5'>sifive_u</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>shakti_c</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sifive_e</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='8'>virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='s390x'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='sh4'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>shix</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>r2d</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='sh4eb'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>shix</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>r2d</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='sparc'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>SS-5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>SS-20</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>LX</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>SS-4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>SS-10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>Voyager</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='sparc64'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sun4u</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>niagara</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>sun4v</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='x86_64'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>64</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>x-remote</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='1'>isapc</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>microvm</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='kvm'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <acpi default='on' toggle='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:       <apic default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='xtensa'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>sim</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>kc705</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>ml605</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>lx200</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>lx60</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]:   <guest>
Apr 17 10:30:17 user nova-compute[82522]:     <os_type>hvm</os_type>
Apr 17 10:30:17 user nova-compute[82522]:     <arch name='xtensaeb'>
Apr 17 10:30:17 user nova-compute[82522]:       <wordsize>32</wordsize>
Apr 17 10:30:17 user nova-compute[82522]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='4'>sim</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>kc705</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>ml605</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>virt</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>lx200</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>lx60</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 17 10:30:17 user nova-compute[82522]:       <domain type='qemu'/>
Apr 17 10:30:17 user nova-compute[82522]:     </arch>
Apr 17 10:30:17 user nova-compute[82522]:     <features>
Apr 17 10:30:17 user nova-compute[82522]:       <cpuselection/>
Apr 17 10:30:17 user nova-compute[82522]:       <deviceboot/>
Apr 17 10:30:17 user nova-compute[82522]:       <disksnapshot default='on' toggle='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     </features>
Apr 17 10:30:17 user nova-compute[82522]:   </guest>
Apr 17 10:30:17 user nova-compute[82522]: </capabilities>
Apr 17 10:30:17 user nova-compute[82522]: 
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 17 10:30:17 user nova-compute[82522]: <domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:   <path>/usr/bin/qemu-system-i386</path>
Apr 17 10:30:17 user nova-compute[82522]:   <domain>kvm</domain>
Apr 17 10:30:17 user nova-compute[82522]:   <machine>pc-i440fx-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:   <arch>i686</arch>
Apr 17 10:30:17 user nova-compute[82522]:   <vcpu max='255'/>
Apr 17 10:30:17 user nova-compute[82522]:   <iothreads supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:   <os supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='firmware'/>
Apr 17 10:30:17 user nova-compute[82522]:     <loader supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>rom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pflash</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='readonly'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='secure'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </loader>
Apr 17 10:30:17 user nova-compute[82522]:   </os>
Apr 17 10:30:17 user nova-compute[82522]:   <cpu>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-passthrough' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='hostPassthroughMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='maximum' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='maximumMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-model' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <vendor>Intel</vendor>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ss'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='vmx'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pcid'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='hypervisor'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arat'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='umip'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='md-clear'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibpb'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibrs'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='erms'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='lm'/>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='custom' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>qemu64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>qemu32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>phenom</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>n270</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>kvm64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>coreduo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>core2duo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>athlon</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Westmere-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Westmere</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Snowridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Penryn</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G5</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G4</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G1</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Nehalem-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Nehalem</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Rome</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Milan</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Dhyana</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cooperlake</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Conroe</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>486</model>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:   </cpu>
Apr 17 10:30:17 user nova-compute[82522]:   <memoryBacking supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='sourceType'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>file</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>anonymous</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>memfd</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:   </memoryBacking>
Apr 17 10:30:17 user nova-compute[82522]:   <devices>
Apr 17 10:30:17 user nova-compute[82522]:     <disk supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='diskDevice'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>disk</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cdrom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>floppy</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>lun</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='bus'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ide</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>fdc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sata</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </disk>
Apr 17 10:30:17 user nova-compute[82522]:     <graphics supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sdl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vnc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>spice</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egl-headless</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </graphics>
Apr 17 10:30:17 user nova-compute[82522]:     <video supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='modelType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cirrus</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vmvga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>qxl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>none</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>bochs</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ramfb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </video>
Apr 17 10:30:17 user nova-compute[82522]:     <hostdev supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='mode'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>subsystem</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='startupPolicy'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>default</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>mandatory</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>requisite</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>optional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='subsysType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pci</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='capsType'/>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='pciBackend'/>
Apr 17 10:30:17 user nova-compute[82522]:     </hostdev>
Apr 17 10:30:17 user nova-compute[82522]:     <rng supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>random</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egd</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>builtin</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </rng>
Apr 17 10:30:17 user nova-compute[82522]:     <filesystem supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='driverType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>path</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>handle</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtiofs</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </filesystem>
Apr 17 10:30:17 user nova-compute[82522]:     <tpm supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-tis</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-crb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>passthrough</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>emulator</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </tpm>
Apr 17 10:30:17 user nova-compute[82522]:   </devices>
Apr 17 10:30:17 user nova-compute[82522]:   <features>
Apr 17 10:30:17 user nova-compute[82522]:     <gic supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     <vmcoreinfo supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <genid supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backingStoreInput supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backup supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <sev supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:   </features>
Apr 17 10:30:17 user nova-compute[82522]: </domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:  {{(pid=82522) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 17 10:30:17 user nova-compute[82522]: <domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:   <path>/usr/bin/qemu-system-i386</path>
Apr 17 10:30:17 user nova-compute[82522]:   <domain>kvm</domain>
Apr 17 10:30:17 user nova-compute[82522]:   <machine>pc-q35-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:   <arch>i686</arch>
Apr 17 10:30:17 user nova-compute[82522]:   <vcpu max='288'/>
Apr 17 10:30:17 user nova-compute[82522]:   <iothreads supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:   <os supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='firmware'/>
Apr 17 10:30:17 user nova-compute[82522]:     <loader supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>rom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pflash</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='readonly'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='secure'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </loader>
Apr 17 10:30:17 user nova-compute[82522]:   </os>
Apr 17 10:30:17 user nova-compute[82522]:   <cpu>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-passthrough' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='hostPassthroughMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='maximum' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='maximumMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-model' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <vendor>Intel</vendor>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ss'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='vmx'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pcid'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='hypervisor'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arat'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='umip'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='md-clear'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibpb'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibrs'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='erms'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='lm'/>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='custom' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>qemu64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>qemu32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>phenom</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>n270</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>kvm64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>coreduo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>core2duo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>athlon</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Westmere-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Westmere</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Snowridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Penryn</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G5</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G4</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G1</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Nehalem-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Nehalem</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Rome</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Milan</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Dhyana</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cooperlake</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Conroe</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>486</model>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:   </cpu>
Apr 17 10:30:17 user nova-compute[82522]:   <memoryBacking supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='sourceType'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>file</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>anonymous</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>memfd</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:   </memoryBacking>
Apr 17 10:30:17 user nova-compute[82522]:   <devices>
Apr 17 10:30:17 user nova-compute[82522]:     <disk supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='diskDevice'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>disk</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cdrom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>floppy</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>lun</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='bus'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>fdc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sata</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </disk>
Apr 17 10:30:17 user nova-compute[82522]:     <graphics supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sdl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vnc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>spice</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egl-headless</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </graphics>
Apr 17 10:30:17 user nova-compute[82522]:     <video supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='modelType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cirrus</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vmvga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>qxl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>none</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>bochs</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ramfb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </video>
Apr 17 10:30:17 user nova-compute[82522]:     <hostdev supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='mode'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>subsystem</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='startupPolicy'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>default</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>mandatory</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>requisite</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>optional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='subsysType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pci</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='capsType'/>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='pciBackend'/>
Apr 17 10:30:17 user nova-compute[82522]:     </hostdev>
Apr 17 10:30:17 user nova-compute[82522]:     <rng supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>random</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egd</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>builtin</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </rng>
Apr 17 10:30:17 user nova-compute[82522]:     <filesystem supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='driverType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>path</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>handle</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtiofs</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </filesystem>
Apr 17 10:30:17 user nova-compute[82522]:     <tpm supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-tis</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-crb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>passthrough</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>emulator</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </tpm>
Apr 17 10:30:17 user nova-compute[82522]:   </devices>
Apr 17 10:30:17 user nova-compute[82522]:   <features>
Apr 17 10:30:17 user nova-compute[82522]:     <gic supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     <vmcoreinfo supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <genid supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backingStoreInput supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backup supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <sev supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:   </features>
Apr 17 10:30:17 user nova-compute[82522]: </domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:  {{(pid=82522) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 17 10:30:17 user nova-compute[82522]: <domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:   <path>/usr/bin/qemu-system-i386</path>
Apr 17 10:30:17 user nova-compute[82522]:   <domain>kvm</domain>
Apr 17 10:30:17 user nova-compute[82522]:   <machine>pc-i440fx-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:   <arch>i686</arch>
Apr 17 10:30:17 user nova-compute[82522]:   <vcpu max='255'/>
Apr 17 10:30:17 user nova-compute[82522]:   <iothreads supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:   <os supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='firmware'/>
Apr 17 10:30:17 user nova-compute[82522]:     <loader supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>rom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pflash</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='readonly'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='secure'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </loader>
Apr 17 10:30:17 user nova-compute[82522]:   </os>
Apr 17 10:30:17 user nova-compute[82522]:   <cpu>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-passthrough' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='hostPassthroughMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='maximum' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='maximumMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-model' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <vendor>Intel</vendor>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ss'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='vmx'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pcid'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='hypervisor'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arat'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='umip'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='md-clear'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibpb'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibrs'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='erms'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='lm'/>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='custom' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>qemu64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>qemu32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>phenom</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>n270</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>kvm64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>coreduo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>core2duo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>athlon</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Westmere-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Westmere</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Snowridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Penryn</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G5</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G4</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G1</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Nehalem-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Nehalem</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Rome</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Milan</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Dhyana</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cooperlake</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Conroe</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>486</model>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:   </cpu>
Apr 17 10:30:17 user nova-compute[82522]:   <memoryBacking supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='sourceType'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>file</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>anonymous</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>memfd</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:   </memoryBacking>
Apr 17 10:30:17 user nova-compute[82522]:   <devices>
Apr 17 10:30:17 user nova-compute[82522]:     <disk supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='diskDevice'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>disk</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cdrom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>floppy</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>lun</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='bus'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ide</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>fdc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sata</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </disk>
Apr 17 10:30:17 user nova-compute[82522]:     <graphics supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sdl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vnc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>spice</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egl-headless</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </graphics>
Apr 17 10:30:17 user nova-compute[82522]:     <video supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='modelType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cirrus</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vmvga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>qxl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>none</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>bochs</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ramfb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </video>
Apr 17 10:30:17 user nova-compute[82522]:     <hostdev supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='mode'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>subsystem</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='startupPolicy'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>default</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>mandatory</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>requisite</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>optional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='subsysType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pci</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='capsType'/>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='pciBackend'/>
Apr 17 10:30:17 user nova-compute[82522]:     </hostdev>
Apr 17 10:30:17 user nova-compute[82522]:     <rng supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>random</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egd</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>builtin</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </rng>
Apr 17 10:30:17 user nova-compute[82522]:     <filesystem supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='driverType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>path</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>handle</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtiofs</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </filesystem>
Apr 17 10:30:17 user nova-compute[82522]:     <tpm supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-tis</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-crb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>passthrough</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>emulator</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </tpm>
Apr 17 10:30:17 user nova-compute[82522]:   </devices>
Apr 17 10:30:17 user nova-compute[82522]:   <features>
Apr 17 10:30:17 user nova-compute[82522]:     <gic supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     <vmcoreinfo supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <genid supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backingStoreInput supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backup supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <sev supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:   </features>
Apr 17 10:30:17 user nova-compute[82522]: </domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:  {{(pid=82522) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 17 10:30:17 user nova-compute[82522]: <domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:   <path>/usr/bin/qemu-system-i386</path>
Apr 17 10:30:17 user nova-compute[82522]:   <domain>kvm</domain>
Apr 17 10:30:17 user nova-compute[82522]:   <machine>pc-q35-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:   <arch>i686</arch>
Apr 17 10:30:17 user nova-compute[82522]:   <vcpu max='288'/>
Apr 17 10:30:17 user nova-compute[82522]:   <iothreads supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:   <os supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='firmware'/>
Apr 17 10:30:17 user nova-compute[82522]:     <loader supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>rom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pflash</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='readonly'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='secure'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </loader>
Apr 17 10:30:17 user nova-compute[82522]:   </os>
Apr 17 10:30:17 user nova-compute[82522]:   <cpu>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-passthrough' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='hostPassthroughMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='maximum' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='maximumMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-model' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <vendor>Intel</vendor>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ss'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='vmx'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pcid'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='hypervisor'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arat'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='umip'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='md-clear'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibpb'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibrs'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='erms'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='lm'/>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='custom' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>qemu64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>qemu32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>phenom</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>n270</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>kvm64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>coreduo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>core2duo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>athlon</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Westmere-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Westmere</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Snowridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Penryn</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G5</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G4</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G1</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Nehalem-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Nehalem</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Rome</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Milan</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Dhyana</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cooperlake</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Conroe</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>486</model>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:   </cpu>
Apr 17 10:30:17 user nova-compute[82522]:   <memoryBacking supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='sourceType'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>file</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>anonymous</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>memfd</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:   </memoryBacking>
Apr 17 10:30:17 user nova-compute[82522]:   <devices>
Apr 17 10:30:17 user nova-compute[82522]:     <disk supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='diskDevice'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>disk</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cdrom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>floppy</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>lun</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='bus'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>fdc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sata</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </disk>
Apr 17 10:30:17 user nova-compute[82522]:     <graphics supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sdl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vnc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>spice</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egl-headless</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </graphics>
Apr 17 10:30:17 user nova-compute[82522]:     <video supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='modelType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cirrus</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vmvga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>qxl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>none</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>bochs</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ramfb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </video>
Apr 17 10:30:17 user nova-compute[82522]:     <hostdev supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='mode'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>subsystem</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='startupPolicy'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>default</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>mandatory</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>requisite</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>optional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='subsysType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pci</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='capsType'/>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='pciBackend'/>
Apr 17 10:30:17 user nova-compute[82522]:     </hostdev>
Apr 17 10:30:17 user nova-compute[82522]:     <rng supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>random</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egd</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>builtin</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </rng>
Apr 17 10:30:17 user nova-compute[82522]:     <filesystem supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='driverType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>path</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>handle</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtiofs</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </filesystem>
Apr 17 10:30:17 user nova-compute[82522]:     <tpm supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-tis</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-crb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>passthrough</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>emulator</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </tpm>
Apr 17 10:30:17 user nova-compute[82522]:   </devices>
Apr 17 10:30:17 user nova-compute[82522]:   <features>
Apr 17 10:30:17 user nova-compute[82522]:     <gic supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     <vmcoreinfo supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <genid supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backingStoreInput supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backup supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <sev supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:   </features>
Apr 17 10:30:17 user nova-compute[82522]: </domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:  {{(pid=82522) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 17 10:30:17 user nova-compute[82522]: <domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 17 10:30:17 user nova-compute[82522]:   <domain>kvm</domain>
Apr 17 10:30:17 user nova-compute[82522]:   <machine>pc-i440fx-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:   <arch>x86_64</arch>
Apr 17 10:30:17 user nova-compute[82522]:   <vcpu max='255'/>
Apr 17 10:30:17 user nova-compute[82522]:   <iothreads supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:   <os supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='firmware'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>efi</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:     <loader supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>rom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pflash</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='readonly'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='secure'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </loader>
Apr 17 10:30:17 user nova-compute[82522]:   </os>
Apr 17 10:30:17 user nova-compute[82522]:   <cpu>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-passthrough' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='hostPassthroughMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='maximum' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='maximumMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-model' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <vendor>Intel</vendor>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ss'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='vmx'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pcid'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='hypervisor'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arat'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='umip'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='md-clear'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='invtsc'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibpb'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibrs'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='rsba'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pschange-mc-no'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='erms'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='custom' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>qemu64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>qemu32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>phenom</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>n270</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>coreduo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>core2duo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>athlon</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Westmere-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Westmere</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Snowridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Penryn</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G5</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G4</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Opteron_G1</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Nehalem</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Rome</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Milan</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Dhyana</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cooperlake</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Conroe</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>486</model>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:   </cpu>
Apr 17 10:30:17 user nova-compute[82522]:   <memoryBacking supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='sourceType'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>file</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>anonymous</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>memfd</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:   </memoryBacking>
Apr 17 10:30:17 user nova-compute[82522]:   <devices>
Apr 17 10:30:17 user nova-compute[82522]:     <disk supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='diskDevice'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>disk</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cdrom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>floppy</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>lun</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='bus'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ide</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>fdc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sata</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </disk>
Apr 17 10:30:17 user nova-compute[82522]:     <graphics supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sdl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vnc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>spice</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egl-headless</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </graphics>
Apr 17 10:30:17 user nova-compute[82522]:     <video supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='modelType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cirrus</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vmvga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>qxl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>none</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>bochs</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ramfb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </video>
Apr 17 10:30:17 user nova-compute[82522]:     <hostdev supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='mode'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>subsystem</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='startupPolicy'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>default</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>mandatory</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>requisite</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>optional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='subsysType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pci</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='capsType'/>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='pciBackend'/>
Apr 17 10:30:17 user nova-compute[82522]:     </hostdev>
Apr 17 10:30:17 user nova-compute[82522]:     <rng supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>random</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egd</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>builtin</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </rng>
Apr 17 10:30:17 user nova-compute[82522]:     <filesystem supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='driverType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>path</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>handle</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtiofs</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </filesystem>
Apr 17 10:30:17 user nova-compute[82522]:     <tpm supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-tis</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-crb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>passthrough</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>emulator</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </tpm>
Apr 17 10:30:17 user nova-compute[82522]:   </devices>
Apr 17 10:30:17 user nova-compute[82522]:   <features>
Apr 17 10:30:17 user nova-compute[82522]:     <gic supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     <vmcoreinfo supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <genid supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backingStoreInput supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backup supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <sev supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:   </features>
Apr 17 10:30:17 user nova-compute[82522]: </domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:  {{(pid=82522) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 17 10:30:17 user nova-compute[82522]: <domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 17 10:30:17 user nova-compute[82522]:   <domain>kvm</domain>
Apr 17 10:30:17 user nova-compute[82522]:   <machine>pc-q35-6.2</machine>
Apr 17 10:30:17 user nova-compute[82522]:   <arch>x86_64</arch>
Apr 17 10:30:17 user nova-compute[82522]:   <vcpu max='288'/>
Apr 17 10:30:17 user nova-compute[82522]:   <iothreads supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:   <os supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='firmware'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>efi</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:     <loader supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>rom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pflash</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='readonly'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='secure'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </loader>
Apr 17 10:30:17 user nova-compute[82522]:   </os>
Apr 17 10:30:17 user nova-compute[82522]:   <cpu>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-passthrough' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='hostPassthroughMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='maximum' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='maximumMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-model' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <vendor>Intel</vendor>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ss'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='vmx'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pcid'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='hypervisor'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arat'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='umip'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='md-clear'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='invtsc'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibpb'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibrs'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='rsba'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pschange-mc-no'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='erms'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='custom' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>qemu64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>qemu32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>phenom</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>n270</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>coreduo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>core2duo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>athlon</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Westmere-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Westmere</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Snowridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Penryn</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G5</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G4</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Opteron_G1</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Nehalem</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Rome</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Milan</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Dhyana</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cooperlake</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Conroe</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>486</model>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:   </cpu>
Apr 17 10:30:17 user nova-compute[82522]:   <memoryBacking supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='sourceType'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>file</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>anonymous</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>memfd</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:   </memoryBacking>
Apr 17 10:30:17 user nova-compute[82522]:   <devices>
Apr 17 10:30:17 user nova-compute[82522]:     <disk supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='diskDevice'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>disk</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cdrom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>floppy</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>lun</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='bus'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>fdc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sata</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </disk>
Apr 17 10:30:17 user nova-compute[82522]:     <graphics supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sdl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vnc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>spice</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egl-headless</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </graphics>
Apr 17 10:30:17 user nova-compute[82522]:     <video supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='modelType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cirrus</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vmvga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>qxl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>none</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>bochs</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ramfb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </video>
Apr 17 10:30:17 user nova-compute[82522]:     <hostdev supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='mode'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>subsystem</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='startupPolicy'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>default</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>mandatory</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>requisite</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>optional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='subsysType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pci</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='capsType'/>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='pciBackend'/>
Apr 17 10:30:17 user nova-compute[82522]:     </hostdev>
Apr 17 10:30:17 user nova-compute[82522]:     <rng supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>random</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egd</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>builtin</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </rng>
Apr 17 10:30:17 user nova-compute[82522]:     <filesystem supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='driverType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>path</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>handle</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtiofs</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </filesystem>
Apr 17 10:30:17 user nova-compute[82522]:     <tpm supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-tis</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-crb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>passthrough</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>emulator</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </tpm>
Apr 17 10:30:17 user nova-compute[82522]:   </devices>
Apr 17 10:30:17 user nova-compute[82522]:   <features>
Apr 17 10:30:17 user nova-compute[82522]:     <gic supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     <vmcoreinfo supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <genid supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backingStoreInput supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backup supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <sev supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:   </features>
Apr 17 10:30:17 user nova-compute[82522]: </domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:  {{(pid=82522) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 17 10:30:17 user nova-compute[82522]: <domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 17 10:30:17 user nova-compute[82522]:   <domain>kvm</domain>
Apr 17 10:30:17 user nova-compute[82522]:   <machine>pc-i440fx-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:   <arch>x86_64</arch>
Apr 17 10:30:17 user nova-compute[82522]:   <vcpu max='255'/>
Apr 17 10:30:17 user nova-compute[82522]:   <iothreads supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:   <os supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='firmware'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>efi</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:     <loader supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>rom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pflash</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='readonly'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='secure'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </loader>
Apr 17 10:30:17 user nova-compute[82522]:   </os>
Apr 17 10:30:17 user nova-compute[82522]:   <cpu>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-passthrough' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='hostPassthroughMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='maximum' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='maximumMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-model' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <vendor>Intel</vendor>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ss'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='vmx'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pcid'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='hypervisor'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arat'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='umip'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='md-clear'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='invtsc'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibpb'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibrs'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='rsba'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pschange-mc-no'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='erms'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='custom' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>qemu64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>qemu32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>phenom</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>n270</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>coreduo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>core2duo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>athlon</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Westmere-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Westmere</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Snowridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Penryn</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G5</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G4</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Opteron_G1</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Nehalem</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Rome</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Milan</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Dhyana</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cooperlake</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Conroe</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>486</model>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:   </cpu>
Apr 17 10:30:17 user nova-compute[82522]:   <memoryBacking supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='sourceType'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>file</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>anonymous</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>memfd</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:   </memoryBacking>
Apr 17 10:30:17 user nova-compute[82522]:   <devices>
Apr 17 10:30:17 user nova-compute[82522]:     <disk supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='diskDevice'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>disk</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cdrom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>floppy</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>lun</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='bus'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ide</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>fdc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sata</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </disk>
Apr 17 10:30:17 user nova-compute[82522]:     <graphics supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sdl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vnc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>spice</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egl-headless</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </graphics>
Apr 17 10:30:17 user nova-compute[82522]:     <video supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='modelType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cirrus</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vmvga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>qxl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>none</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>bochs</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ramfb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </video>
Apr 17 10:30:17 user nova-compute[82522]:     <hostdev supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='mode'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>subsystem</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='startupPolicy'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>default</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>mandatory</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>requisite</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>optional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='subsysType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pci</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='capsType'/>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='pciBackend'/>
Apr 17 10:30:17 user nova-compute[82522]:     </hostdev>
Apr 17 10:30:17 user nova-compute[82522]:     <rng supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>random</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egd</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>builtin</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </rng>
Apr 17 10:30:17 user nova-compute[82522]:     <filesystem supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='driverType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>path</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>handle</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtiofs</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </filesystem>
Apr 17 10:30:17 user nova-compute[82522]:     <tpm supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-tis</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-crb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>passthrough</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>emulator</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </tpm>
Apr 17 10:30:17 user nova-compute[82522]:   </devices>
Apr 17 10:30:17 user nova-compute[82522]:   <features>
Apr 17 10:30:17 user nova-compute[82522]:     <gic supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     <vmcoreinfo supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <genid supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backingStoreInput supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backup supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <sev supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:   </features>
Apr 17 10:30:17 user nova-compute[82522]: </domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:  {{(pid=82522) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 17 10:30:17 user nova-compute[82522]: <domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 17 10:30:17 user nova-compute[82522]:   <domain>kvm</domain>
Apr 17 10:30:17 user nova-compute[82522]:   <machine>pc-q35-jammy</machine>
Apr 17 10:30:17 user nova-compute[82522]:   <arch>x86_64</arch>
Apr 17 10:30:17 user nova-compute[82522]:   <vcpu max='288'/>
Apr 17 10:30:17 user nova-compute[82522]:   <iothreads supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:   <os supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='firmware'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>efi</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:     <loader supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>rom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pflash</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='readonly'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='secure'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>yes</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>no</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </loader>
Apr 17 10:30:17 user nova-compute[82522]:   </os>
Apr 17 10:30:17 user nova-compute[82522]:   <cpu>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-passthrough' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='hostPassthroughMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='maximum' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='maximumMigratable'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>on</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>off</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='host-model' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <vendor>Intel</vendor>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ss'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='vmx'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pcid'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='hypervisor'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arat'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='umip'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='md-clear'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='invtsc'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibpb'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='ibrs'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-stibp'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='rsba'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='require' name='pschange-mc-no'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='erms'/>
Apr 17 10:30:17 user nova-compute[82522]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:     <mode name='custom' supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>qemu64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>qemu32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>phenom</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>pentium</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>n270</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm64</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>kvm32</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>coreduo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>core2duo</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>athlon</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Westmere-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Westmere</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Snowridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Skylake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>SandyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Penryn</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G5</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G4</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G3</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Opteron_G2</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Opteron_G1</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Nehalem</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>IvyBridge</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Icelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Haswell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Rome</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-Milan</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>EPYC</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Dhyana</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cooperlake</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>Conroe</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='no'>Broadwell</model>
Apr 17 10:30:17 user nova-compute[82522]:       <model usable='yes'>486</model>
Apr 17 10:30:17 user nova-compute[82522]:     </mode>
Apr 17 10:30:17 user nova-compute[82522]:   </cpu>
Apr 17 10:30:17 user nova-compute[82522]:   <memoryBacking supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:     <enum name='sourceType'>
Apr 17 10:30:17 user nova-compute[82522]:       <value>file</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>anonymous</value>
Apr 17 10:30:17 user nova-compute[82522]:       <value>memfd</value>
Apr 17 10:30:17 user nova-compute[82522]:     </enum>
Apr 17 10:30:17 user nova-compute[82522]:   </memoryBacking>
Apr 17 10:30:17 user nova-compute[82522]:   <devices>
Apr 17 10:30:17 user nova-compute[82522]:     <disk supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='diskDevice'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>disk</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cdrom</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>floppy</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>lun</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='bus'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>fdc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sata</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </disk>
Apr 17 10:30:17 user nova-compute[82522]:     <graphics supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='type'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>sdl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vnc</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>spice</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egl-headless</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </graphics>
Apr 17 10:30:17 user nova-compute[82522]:     <video supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='modelType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>cirrus</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>vmvga</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>qxl</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>none</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>bochs</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>ramfb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </video>
Apr 17 10:30:17 user nova-compute[82522]:     <hostdev supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='mode'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>subsystem</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='startupPolicy'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>default</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>mandatory</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>requisite</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>optional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='subsysType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>usb</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>pci</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>scsi</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='capsType'/>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='pciBackend'/>
Apr 17 10:30:17 user nova-compute[82522]:     </hostdev>
Apr 17 10:30:17 user nova-compute[82522]:     <rng supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtio-non-transitional</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>random</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>egd</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>builtin</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </rng>
Apr 17 10:30:17 user nova-compute[82522]:     <filesystem supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='driverType'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>path</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>handle</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>virtiofs</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </filesystem>
Apr 17 10:30:17 user nova-compute[82522]:     <tpm supported='yes'>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='model'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-tis</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>tpm-crb</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:       <enum name='backendModel'>
Apr 17 10:30:17 user nova-compute[82522]:         <value>passthrough</value>
Apr 17 10:30:17 user nova-compute[82522]:         <value>emulator</value>
Apr 17 10:30:17 user nova-compute[82522]:       </enum>
Apr 17 10:30:17 user nova-compute[82522]:     </tpm>
Apr 17 10:30:17 user nova-compute[82522]:   </devices>
Apr 17 10:30:17 user nova-compute[82522]:   <features>
Apr 17 10:30:17 user nova-compute[82522]:     <gic supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:     <vmcoreinfo supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <genid supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backingStoreInput supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <backup supported='yes'/>
Apr 17 10:30:17 user nova-compute[82522]:     <sev supported='no'/>
Apr 17 10:30:17 user nova-compute[82522]:   </features>
Apr 17 10:30:17 user nova-compute[82522]: </domainCapabilities>
Apr 17 10:30:17 user nova-compute[82522]:  {{(pid=82522) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=82522) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=82522) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Checking secure boot support for host arch (x86_64) {{(pid=82522) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Checking secure boot support for host arch (x86_64) {{(pid=82522) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Checking secure boot support for host arch (x86_64) {{(pid=82522) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 17 10:30:17 user nova-compute[82522]: INFO nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Secure Boot support detected
Apr 17 10:30:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] cpu compare xml: <cpu match="exact">
Apr 17 10:30:17 user nova-compute[82522]:   <model>Nehalem</model>
Apr 17 10:30:17 user nova-compute[82522]: </cpu>
Apr 17 10:30:17 user nova-compute[82522]:  {{(pid=82522) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 17 10:30:18 user nova-compute[82522]: INFO nova.virt.node [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Generated node identity 152e783c-5f4a-4c29-a7c0-63b63ff61fda
Apr 17 10:30:18 user nova-compute[82522]: INFO nova.virt.node [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Wrote node identity 152e783c-5f4a-4c29-a7c0-63b63ff61fda to /opt/stack/data/nova/compute_id
Apr 17 10:30:18 user nova-compute[82522]: WARNING nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Compute nodes ['152e783c-5f4a-4c29-a7c0-63b63ff61fda'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 17 10:30:18 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 17 10:30:18 user nova-compute[82522]: WARNING nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 17 10:30:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:30:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:30:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:30:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:30:18 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:30:18 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:30:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Hypervisor/Node resource view: name=user free_ram=10894MB free_disk=27.264057159423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:30:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:30:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:30:18 user nova-compute[82522]: WARNING nova.compute.resource_tracker [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] No compute node record for user:152e783c-5f4a-4c29-a7c0-63b63ff61fda: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 152e783c-5f4a-4c29-a7c0-63b63ff61fda could not be found.
Apr 17 10:30:18 user nova-compute[82522]: INFO nova.compute.resource_tracker [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Compute node record created for user:user with uuid: 152e783c-5f4a-4c29-a7c0-63b63ff61fda
Apr 17 10:30:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:30:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:30:18 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [req-f1ef8d47-a925-417a-9598-c522c75932a0] Created resource provider record via placement API for resource provider with UUID 152e783c-5f4a-4c29-a7c0-63b63ff61fda and name user.
Apr 17 10:30:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=82522) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 17 10:30:18 user nova-compute[82522]: INFO nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] kernel doesn't support AMD SEV
Apr 17 10:30:18 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 10:30:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:30:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Libvirt baseline CPU <cpu>
Apr 17 10:30:18 user nova-compute[82522]:   <arch>x86_64</arch>
Apr 17 10:30:18 user nova-compute[82522]:   <model>Nehalem</model>
Apr 17 10:30:18 user nova-compute[82522]:   <vendor>Intel</vendor>
Apr 17 10:30:18 user nova-compute[82522]:   <topology sockets="6" cores="1" threads="1"/>
Apr 17 10:30:18 user nova-compute[82522]: </cpu>
Apr 17 10:30:18 user nova-compute[82522]:  {{(pid=82522) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 17 10:30:19 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Updated inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 17 10:30:19 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Updating resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda generation from 0 to 1 during operation: update_inventory {{(pid=82522) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 17 10:30:19 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 10:30:19 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Updating resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda generation from 1 to 2 during operation: update_traits {{(pid=82522) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 17 10:30:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:30:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:30:19 user nova-compute[82522]: DEBUG nova.service [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Creating RPC server for service compute {{(pid=82522) start /opt/stack/nova/nova/service.py:182}}
Apr 17 10:30:19 user nova-compute[82522]: DEBUG nova.service [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Join ServiceGroup membership for this service compute {{(pid=82522) start /opt/stack/nova/nova/service.py:199}}
Apr 17 10:30:19 user nova-compute[82522]: DEBUG nova.servicegroup.drivers.db [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=82522) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:31:10 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:31:10 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:31:10 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=10209MB free_disk=27.17786407470703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:31:10 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:31:11 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:31:11 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:31:11 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:31:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:31:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:32:10 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:32:10 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=10192MB free_disk=27.2254638671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:32:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:32:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:32:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:33:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:33:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:33:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:33:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:33:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:33:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 10:33:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:33:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:33:11 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:33:11 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:33:11 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=10155MB free_disk=27.004119873046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:33:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:33:12 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:33:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:33:13 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:34:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:34:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:34:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 10:34:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:34:12 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:12 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:12 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=9536MB free_disk=27.032577514648438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:34:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:13 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:34:14 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:14 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:34:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "60008675-7786-4a26-9640-49da6efd0adb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "60008675-7786-4a26-9640-49da6efd0adb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:34:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:34:30 user nova-compute[82522]: INFO nova.compute.claims [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Claim successful on node user
Apr 17 10:34:30 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:34:30 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:34:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:34:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:34:30 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:34:30 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:34:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:34:31 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Creating image(s)
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "/opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "/opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "/opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853.part --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG nova.virt.images [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 66764afd-311a-41a0-a068-b2937b23acba was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853.part /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853.part /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853.converted" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG nova.policy [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.842s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:31 user nova-compute[82522]: INFO oslo.privsep.daemon [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4805gwc7/privsep.sock']
Apr 17 10:34:31 user sudo[91237]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4805gwc7/privsep.sock
Apr 17 10:34:32 user sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 17 10:34:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:34:33 user nova-compute[82522]: INFO nova.compute.claims [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Claim successful on node user
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:34:33 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.policy [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f4863ef9d61412a997abf4f27cce1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02daa1fd267646fbb4f726b247ba4a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:34:33 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Creating image(s)
Apr 17 10:34:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "/opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "/opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Successfully created port: d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:34:33 user sudo[91237]: pam_unix(sudo:session): session closed for user root
Apr 17 10:34:33 user nova-compute[82522]: INFO oslo.privsep.daemon [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Spawned new privsep daemon via rootwrap
Apr 17 10:34:33 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 17 10:34:33 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 17 10:34:33 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 17 10:34:33 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91248
Apr 17 10:34:33 user nova-compute[82522]: WARNING oslo_privsep.priv_context [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] privsep daemon already running
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.171s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.129s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk 1073741824" returned: 0 in 0.043s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.166s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk 1073741824" returned: 0 in 0.069s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Cannot resize image /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'migration_context' on Instance uuid 60008675-7786-4a26-9640-49da6efd0adb {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Ensure instance console log exists: /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.127s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Successfully updated port: d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquired lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Cannot resize image /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lazy-loading 'migration_context' on Instance uuid 6cc638ee-d494-4523-8d12-9ede0853ecd6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Ensure instance console log exists: /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received event network-changed-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Refreshing instance network info cache due to event network-changed-d6e0e749-1043-40c1-8401-8aae219f3924. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Acquiring lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updating instance_info_cache with network_info: [{"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Releasing lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Instance network_info: |[{"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Acquired lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.network.neutron [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Refreshing network info cache for port d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Start _get_guest_xml network_info=[{"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:34:35 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:35 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:34:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-611330270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-611330270',id=1,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-xp74pm1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:31Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=60008675-7786-4a26-9640-49da6efd0adb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:dc:bf,bridge_name='br-int',has_traffic_filtering=True,id=d6e0e749-1043-40c1-8401-8aae219f3924,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e0e749-10') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'pci_devices' on Instance uuid 60008675-7786-4a26-9640-49da6efd0adb {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:34:36 user nova-compute[82522]:   <uuid>60008675-7786-4a26-9640-49da6efd0adb</uuid>
Apr 17 10:34:36 user nova-compute[82522]:   <name>instance-00000001</name>
Apr 17 10:34:36 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:34:36 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:34:36 user nova-compute[82522]:   <metadata>
Apr 17 10:34:36 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:34:36 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:34:36 user nova-compute[82522]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-611330270</nova:name>
Apr 17 10:34:36 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:34:35</nova:creationTime>
Apr 17 10:34:36 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:34:36 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:34:36 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:34:36 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:34:36 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:34:36 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:34:36 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:34:36 user nova-compute[82522]:       <nova:owner>
Apr 17 10:34:36 user nova-compute[82522]:         <nova:user uuid="d8cb73d24d324903a625e4782270120e">tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member</nova:user>
Apr 17 10:34:36 user nova-compute[82522]:         <nova:project uuid="faab4afa0ddf45578232627c2fac2ff8">tempest-ServerBootFromVolumeStableRescueTest-933538997</nova:project>
Apr 17 10:34:36 user nova-compute[82522]:       </nova:owner>
Apr 17 10:34:36 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:34:36 user nova-compute[82522]:       <nova:ports>
Apr 17 10:34:36 user nova-compute[82522]:         <nova:port uuid="d6e0e749-1043-40c1-8401-8aae219f3924">
Apr 17 10:34:36 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:34:36 user nova-compute[82522]:         </nova:port>
Apr 17 10:34:36 user nova-compute[82522]:       </nova:ports>
Apr 17 10:34:36 user nova-compute[82522]:     </nova:instance>
Apr 17 10:34:36 user nova-compute[82522]:   </metadata>
Apr 17 10:34:36 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:34:36 user nova-compute[82522]:     <system>
Apr 17 10:34:36 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:34:36 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:34:36 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:34:36 user nova-compute[82522]:       <entry name="serial">60008675-7786-4a26-9640-49da6efd0adb</entry>
Apr 17 10:34:36 user nova-compute[82522]:       <entry name="uuid">60008675-7786-4a26-9640-49da6efd0adb</entry>
Apr 17 10:34:36 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:34:36 user nova-compute[82522]:     </system>
Apr 17 10:34:36 user nova-compute[82522]:   </sysinfo>
Apr 17 10:34:36 user nova-compute[82522]:   <os>
Apr 17 10:34:36 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:34:36 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:34:36 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:34:36 user nova-compute[82522]:   </os>
Apr 17 10:34:36 user nova-compute[82522]:   <features>
Apr 17 10:34:36 user nova-compute[82522]:     <acpi/>
Apr 17 10:34:36 user nova-compute[82522]:     <apic/>
Apr 17 10:34:36 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:34:36 user nova-compute[82522]:   </features>
Apr 17 10:34:36 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:34:36 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:34:36 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:34:36 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:34:36 user nova-compute[82522]:   </clock>
Apr 17 10:34:36 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:34:36 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:34:36 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:34:36 user nova-compute[82522]:   </cpu>
Apr 17 10:34:36 user nova-compute[82522]:   <devices>
Apr 17 10:34:36 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:34:36 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:34:36 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk"/>
Apr 17 10:34:36 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:34:36 user nova-compute[82522]:     </disk>
Apr 17 10:34:36 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:34:36 user nova-compute[82522]:       <mac address="fa:16:3e:da:dc:bf"/>
Apr 17 10:34:36 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:36 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:34:36 user nova-compute[82522]:       <target dev="tapd6e0e749-10"/>
Apr 17 10:34:36 user nova-compute[82522]:     </interface>
Apr 17 10:34:36 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:34:36 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/console.log" append="off"/>
Apr 17 10:34:36 user nova-compute[82522]:     </serial>
Apr 17 10:34:36 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:34:36 user nova-compute[82522]:     <video>
Apr 17 10:34:36 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:36 user nova-compute[82522]:     </video>
Apr 17 10:34:36 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:34:36 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:34:36 user nova-compute[82522]:     </rng>
Apr 17 10:34:36 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:34:36 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:34:36 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:34:36 user nova-compute[82522]:     </memballoon>
Apr 17 10:34:36 user nova-compute[82522]:   </devices>
Apr 17 10:34:36 user nova-compute[82522]: </domain>
Apr 17 10:34:36 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-611330270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-611330270',id=1,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-xp74pm1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:31Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=60008675-7786-4a26-9640-49da6efd0adb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:dc:bf,bridge_name='br-int',has_traffic_filtering=True,id=d6e0e749-1043-40c1-8401-8aae219f3924,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e0e749-10') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG os_vif [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:dc:bf,bridge_name='br-int',has_traffic_filtering=True,id=d6e0e749-1043-40c1-8401-8aae219f3924,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e0e749-10') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Created schema index Interface.name {{(pid=82522) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Created schema index Port.name {{(pid=82522) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Created schema index Bridge.name {{(pid=82522) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [POLLOUT] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:34:36 user nova-compute[82522]: INFO oslo.privsep.daemon [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp5p542hgs/privsep.sock']
Apr 17 10:34:36 user sudo[91281]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp5p542hgs/privsep.sock
Apr 17 10:34:36 user sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 17 10:34:36 user nova-compute[82522]: DEBUG nova.network.neutron [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Successfully created port: d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:34:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updated VIF entry in instance network info cache for port d6e0e749-1043-40c1-8401-8aae219f3924. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:34:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updating instance_info_cache with network_info: [{"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Releasing lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:38 user sudo[91281]: pam_unix(sudo:session): session closed for user root
Apr 17 10:34:38 user nova-compute[82522]: INFO oslo.privsep.daemon [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Spawned new privsep daemon via rootwrap
Apr 17 10:34:38 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 17 10:34:38 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 17 10:34:38 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 17 10:34:38 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91286
Apr 17 10:34:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6e0e749-10, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6e0e749-10, col_values=(('external_ids', {'iface-id': 'd6e0e749-1043-40c1-8401-8aae219f3924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:dc:bf', 'vm-uuid': '60008675-7786-4a26-9640-49da6efd0adb'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:34:38 user nova-compute[82522]: INFO os_vif [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:dc:bf,bridge_name='br-int',has_traffic_filtering=True,id=d6e0e749-1043-40c1-8401-8aae219f3924,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e0e749-10')
Apr 17 10:34:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:34:38 user nova-compute[82522]: INFO nova.compute.claims [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Claim successful on node user
Apr 17 10:34:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:34:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No VIF found with MAC fa:16:3e:da:dc:bf, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.network.neutron [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:34:39 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.network.neutron [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Successfully updated port: d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "refresh_cache-6cc638ee-d494-4523-8d12-9ede0853ecd6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquired lock "refresh_cache-6cc638ee-d494-4523-8d12-9ede0853ecd6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.network.neutron [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:34:39 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Creating image(s)
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "/opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "/opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "/opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.policy [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.166s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.network.neutron [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.159s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk 1073741824" returned: 0 in 0.054s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received event network-changed-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Refreshing instance network info cache due to event network-changed-d6ac6671-38e6-49a1-ba35-e903ffc15afa. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Acquiring lock "refresh_cache-6cc638ee-d494-4523-8d12-9ede0853ecd6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.178s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:34:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Cannot resize image /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.objects.instance [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'migration_context' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Ensure instance console log exists: /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Updating instance_info_cache with network_info: [{"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Releasing lock "refresh_cache-6cc638ee-d494-4523-8d12-9ede0853ecd6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Instance network_info: |[{"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Acquired lock "refresh_cache-6cc638ee-d494-4523-8d12-9ede0853ecd6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.network.neutron [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Refreshing network info cache for port d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Start _get_guest_xml network_info=[{"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Successfully created port: 7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:34:40 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:40 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2104151254',display_name='tempest-DeleteServersTestJSON-server-2104151254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2104151254',id=2,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02daa1fd267646fbb4f726b247ba4a6b',ramdisk_id='',reservation_id='r-n5a5xrbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1683071550',owner_user_name='tempest-DeleteServersTestJSON-1683071550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:34Z,user_data=None,user_id='7f4863ef9d61412a997abf4f27cce1b7',uuid=6cc638ee-d494-4523-8d12-9ede0853ecd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Converting VIF {"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5d:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6ac6671-38e6-49a1-ba35-e903ffc15afa,network=Network(7923a088-f9c0-4c11-9907-e94389c269f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ac6671-38') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cc638ee-d494-4523-8d12-9ede0853ecd6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:34:41 user nova-compute[82522]: INFO nova.compute.claims [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Claim successful on node user
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:34:41 user nova-compute[82522]:   <uuid>6cc638ee-d494-4523-8d12-9ede0853ecd6</uuid>
Apr 17 10:34:41 user nova-compute[82522]:   <name>instance-00000002</name>
Apr 17 10:34:41 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:34:41 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:34:41 user nova-compute[82522]:   <metadata>
Apr 17 10:34:41 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:34:41 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:34:41 user nova-compute[82522]:       <nova:name>tempest-DeleteServersTestJSON-server-2104151254</nova:name>
Apr 17 10:34:41 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:34:40</nova:creationTime>
Apr 17 10:34:41 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:34:41 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:34:41 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:34:41 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:34:41 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:34:41 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:34:41 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:34:41 user nova-compute[82522]:       <nova:owner>
Apr 17 10:34:41 user nova-compute[82522]:         <nova:user uuid="7f4863ef9d61412a997abf4f27cce1b7">tempest-DeleteServersTestJSON-1683071550-project-member</nova:user>
Apr 17 10:34:41 user nova-compute[82522]:         <nova:project uuid="02daa1fd267646fbb4f726b247ba4a6b">tempest-DeleteServersTestJSON-1683071550</nova:project>
Apr 17 10:34:41 user nova-compute[82522]:       </nova:owner>
Apr 17 10:34:41 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:34:41 user nova-compute[82522]:       <nova:ports>
Apr 17 10:34:41 user nova-compute[82522]:         <nova:port uuid="d6ac6671-38e6-49a1-ba35-e903ffc15afa">
Apr 17 10:34:41 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 10:34:41 user nova-compute[82522]:         </nova:port>
Apr 17 10:34:41 user nova-compute[82522]:       </nova:ports>
Apr 17 10:34:41 user nova-compute[82522]:     </nova:instance>
Apr 17 10:34:41 user nova-compute[82522]:   </metadata>
Apr 17 10:34:41 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:34:41 user nova-compute[82522]:     <system>
Apr 17 10:34:41 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:34:41 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:34:41 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:34:41 user nova-compute[82522]:       <entry name="serial">6cc638ee-d494-4523-8d12-9ede0853ecd6</entry>
Apr 17 10:34:41 user nova-compute[82522]:       <entry name="uuid">6cc638ee-d494-4523-8d12-9ede0853ecd6</entry>
Apr 17 10:34:41 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:34:41 user nova-compute[82522]:     </system>
Apr 17 10:34:41 user nova-compute[82522]:   </sysinfo>
Apr 17 10:34:41 user nova-compute[82522]:   <os>
Apr 17 10:34:41 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:34:41 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:34:41 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:34:41 user nova-compute[82522]:   </os>
Apr 17 10:34:41 user nova-compute[82522]:   <features>
Apr 17 10:34:41 user nova-compute[82522]:     <acpi/>
Apr 17 10:34:41 user nova-compute[82522]:     <apic/>
Apr 17 10:34:41 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:34:41 user nova-compute[82522]:   </features>
Apr 17 10:34:41 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:34:41 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:34:41 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:34:41 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:34:41 user nova-compute[82522]:   </clock>
Apr 17 10:34:41 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:34:41 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:34:41 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:34:41 user nova-compute[82522]:   </cpu>
Apr 17 10:34:41 user nova-compute[82522]:   <devices>
Apr 17 10:34:41 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:34:41 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:34:41 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk"/>
Apr 17 10:34:41 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:34:41 user nova-compute[82522]:     </disk>
Apr 17 10:34:41 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:34:41 user nova-compute[82522]:       <mac address="fa:16:3e:6c:5d:f5"/>
Apr 17 10:34:41 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:41 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:34:41 user nova-compute[82522]:       <target dev="tapd6ac6671-38"/>
Apr 17 10:34:41 user nova-compute[82522]:     </interface>
Apr 17 10:34:41 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:34:41 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/console.log" append="off"/>
Apr 17 10:34:41 user nova-compute[82522]:     </serial>
Apr 17 10:34:41 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:34:41 user nova-compute[82522]:     <video>
Apr 17 10:34:41 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:41 user nova-compute[82522]:     </video>
Apr 17 10:34:41 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:34:41 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:34:41 user nova-compute[82522]:     </rng>
Apr 17 10:34:41 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:34:41 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:34:41 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:34:41 user nova-compute[82522]:     </memballoon>
Apr 17 10:34:41 user nova-compute[82522]:   </devices>
Apr 17 10:34:41 user nova-compute[82522]: </domain>
Apr 17 10:34:41 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2104151254',display_name='tempest-DeleteServersTestJSON-server-2104151254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2104151254',id=2,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02daa1fd267646fbb4f726b247ba4a6b',ramdisk_id='',reservation_id='r-n5a5xrbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1683071550',owner_user_name='tempest-DeleteServersTestJSON-1683071550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:34Z,user_data=None,user_id='7f4863ef9d61412a997abf4f27cce1b7',uuid=6cc638ee-d494-4523-8d12-9ede0853ecd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Converting VIF {"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5d:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6ac6671-38e6-49a1-ba35-e903ffc15afa,network=Network(7923a088-f9c0-4c11-9907-e94389c269f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ac6671-38') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG os_vif [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5d:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6ac6671-38e6-49a1-ba35-e903ffc15afa,network=Network(7923a088-f9c0-4c11-9907-e94389c269f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ac6671-38') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6ac6671-38, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6ac6671-38, col_values=(('external_ids', {'iface-id': 'd6ac6671-38e6-49a1-ba35-e903ffc15afa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:5d:f5', 'vm-uuid': '6cc638ee-d494-4523-8d12-9ede0853ecd6'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:41 user nova-compute[82522]: INFO os_vif [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5d:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6ac6671-38e6-49a1-ba35-e903ffc15afa,network=Network(7923a088-f9c0-4c11-9907-e94389c269f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ac6671-38')
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] No VIF found with MAC fa:16:3e:6c:5d:f5, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:34:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:34:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Creating image(s)
Apr 17 10:34:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received event network-vif-plugged-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] Acquiring lock "60008675-7786-4a26-9640-49da6efd0adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] No waiting events found dispatching network-vif-plugged-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:34:41 user nova-compute[82522]: WARNING nova.compute.manager [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received unexpected event network-vif-plugged-d6e0e749-1043-40c1-8401-8aae219f3924 for instance with vm_state building and task_state spawning.
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727681.9210699, 60008675-7786-4a26-9640-49da6efd0adb => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:34:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] VM Resumed (Lifecycle Event)
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.policy [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:34:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Instance spawned successfully.
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.230s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727681.930321, 60008675-7786-4a26-9640-49da6efd0adb => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:34:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] VM Started (Lifecycle Event)
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.173s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:42 user nova-compute[82522]: INFO nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Took 11.17 seconds to spawn the instance on the hypervisor.
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk 1073741824" returned: 0 in 0.118s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:34:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Successfully updated port: 7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquired lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.173s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:34:42 user nova-compute[82522]: INFO nova.compute.manager [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Took 12.36 seconds to build instance.
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-changed-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Refreshing instance network info cache due to event network-changed-7124043d-665c-4a42-a041-b91ccc237b63. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Acquiring lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "60008675-7786-4a26-9640-49da6efd0adb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.658s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Cannot resize image /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.objects.instance [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'migration_context' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Ensure instance console log exists: /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Updated VIF entry in instance network info cache for port d6ac6671-38e6-49a1-ba35-e903ffc15afa. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Updating instance_info_cache with network_info: [{"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Releasing lock "refresh_cache-6cc638ee-d494-4523-8d12-9ede0853ecd6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.network.neutron [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updating instance_info_cache with network_info: [{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Releasing lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance network_info: |[{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Acquired lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.network.neutron [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Refreshing network info cache for port 7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Start _get_guest_xml network_info=[{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:34:43 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:43 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-92438997',display_name='tempest-AttachVolumeTestJSON-server-92438997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-92438997',id=3,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw==',key_name='tempest-keypair-1429660859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-ip2vpwam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=59fd26de-d46e-4f41-91f6-090005a07d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.objects.instance [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'pci_devices' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:34:43 user nova-compute[82522]:   <uuid>59fd26de-d46e-4f41-91f6-090005a07d99</uuid>
Apr 17 10:34:43 user nova-compute[82522]:   <name>instance-00000003</name>
Apr 17 10:34:43 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:34:43 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:34:43 user nova-compute[82522]:   <metadata>
Apr 17 10:34:43 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:34:43 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:34:43 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeTestJSON-server-92438997</nova:name>
Apr 17 10:34:43 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:34:43</nova:creationTime>
Apr 17 10:34:43 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:34:43 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:34:43 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:34:43 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:34:43 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:34:43 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:34:43 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:34:43 user nova-compute[82522]:       <nova:owner>
Apr 17 10:34:43 user nova-compute[82522]:         <nova:user uuid="a9862432f87f4500a46f32a0b27d54d4">tempest-AttachVolumeTestJSON-2096000567-project-member</nova:user>
Apr 17 10:34:43 user nova-compute[82522]:         <nova:project uuid="6a17ec3e1b314acbb701f2d2d27d0560">tempest-AttachVolumeTestJSON-2096000567</nova:project>
Apr 17 10:34:43 user nova-compute[82522]:       </nova:owner>
Apr 17 10:34:43 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:34:43 user nova-compute[82522]:       <nova:ports>
Apr 17 10:34:43 user nova-compute[82522]:         <nova:port uuid="7124043d-665c-4a42-a041-b91ccc237b63">
Apr 17 10:34:43 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:34:43 user nova-compute[82522]:         </nova:port>
Apr 17 10:34:43 user nova-compute[82522]:       </nova:ports>
Apr 17 10:34:43 user nova-compute[82522]:     </nova:instance>
Apr 17 10:34:43 user nova-compute[82522]:   </metadata>
Apr 17 10:34:43 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:34:43 user nova-compute[82522]:     <system>
Apr 17 10:34:43 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:34:43 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:34:43 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:34:43 user nova-compute[82522]:       <entry name="serial">59fd26de-d46e-4f41-91f6-090005a07d99</entry>
Apr 17 10:34:43 user nova-compute[82522]:       <entry name="uuid">59fd26de-d46e-4f41-91f6-090005a07d99</entry>
Apr 17 10:34:43 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:34:43 user nova-compute[82522]:     </system>
Apr 17 10:34:43 user nova-compute[82522]:   </sysinfo>
Apr 17 10:34:43 user nova-compute[82522]:   <os>
Apr 17 10:34:43 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:34:43 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:34:43 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:34:43 user nova-compute[82522]:   </os>
Apr 17 10:34:43 user nova-compute[82522]:   <features>
Apr 17 10:34:43 user nova-compute[82522]:     <acpi/>
Apr 17 10:34:43 user nova-compute[82522]:     <apic/>
Apr 17 10:34:43 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:34:43 user nova-compute[82522]:   </features>
Apr 17 10:34:43 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:34:43 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:34:43 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:34:43 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:34:43 user nova-compute[82522]:   </clock>
Apr 17 10:34:43 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:34:43 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:34:43 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:34:43 user nova-compute[82522]:   </cpu>
Apr 17 10:34:43 user nova-compute[82522]:   <devices>
Apr 17 10:34:43 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:34:43 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:34:43 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk"/>
Apr 17 10:34:43 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:34:43 user nova-compute[82522]:     </disk>
Apr 17 10:34:43 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:34:43 user nova-compute[82522]:       <mac address="fa:16:3e:7f:75:70"/>
Apr 17 10:34:43 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:43 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:34:43 user nova-compute[82522]:       <target dev="tap7124043d-66"/>
Apr 17 10:34:43 user nova-compute[82522]:     </interface>
Apr 17 10:34:43 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:34:43 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/console.log" append="off"/>
Apr 17 10:34:43 user nova-compute[82522]:     </serial>
Apr 17 10:34:43 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:34:43 user nova-compute[82522]:     <video>
Apr 17 10:34:43 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:43 user nova-compute[82522]:     </video>
Apr 17 10:34:43 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:34:43 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:34:43 user nova-compute[82522]:     </rng>
Apr 17 10:34:43 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:34:43 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:34:43 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:34:43 user nova-compute[82522]:     </memballoon>
Apr 17 10:34:43 user nova-compute[82522]:   </devices>
Apr 17 10:34:43 user nova-compute[82522]: </domain>
Apr 17 10:34:43 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-92438997',display_name='tempest-AttachVolumeTestJSON-server-92438997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-92438997',id=3,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw==',key_name='tempest-keypair-1429660859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-ip2vpwam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=59fd26de-d46e-4f41-91f6-090005a07d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG os_vif [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7124043d-66, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7124043d-66, col_values=(('external_ids', {'iface-id': '7124043d-665c-4a42-a041-b91ccc237b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:75:70', 'vm-uuid': '59fd26de-d46e-4f41-91f6-090005a07d99'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:43 user nova-compute[82522]: INFO os_vif [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66')
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No VIF found with MAC fa:16:3e:7f:75:70, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received event network-vif-plugged-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Acquiring lock "60008675-7786-4a26-9640-49da6efd0adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] No waiting events found dispatching network-vif-plugged-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:34:43 user nova-compute[82522]: WARNING nova.compute.manager [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received unexpected event network-vif-plugged-d6e0e749-1043-40c1-8401-8aae219f3924 for instance with vm_state active and task_state None.
Apr 17 10:34:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received event network-vif-plugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Acquiring lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] No waiting events found dispatching network-vif-plugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:34:44 user nova-compute[82522]: WARNING nova.compute.manager [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received unexpected event network-vif-plugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance with vm_state building and task_state spawning.
Apr 17 10:34:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received event network-vif-plugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Acquiring lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] No waiting events found dispatching network-vif-plugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:34:44 user nova-compute[82522]: WARNING nova.compute.manager [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received unexpected event network-vif-plugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance with vm_state building and task_state spawning.
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.network.neutron [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Successfully created port: cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.network.neutron [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updated VIF entry in instance network info cache for port 7124043d-665c-4a42-a041-b91ccc237b63. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.network.neutron [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updating instance_info_cache with network_info: [{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Releasing lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727685.3559875, 6cc638ee-d494-4523-8d12-9ede0853ecd6 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:34:45 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] VM Resumed (Lifecycle Event)
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Instance spawned successfully.
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:34:45 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727685.4055407, 6cc638ee-d494-4523-8d12-9ede0853ecd6 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:34:45 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] VM Started (Lifecycle Event)
Apr 17 10:34:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:45 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:34:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:34:45 user nova-compute[82522]: INFO nova.compute.claims [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Claim successful on node user
Apr 17 10:34:45 user nova-compute[82522]: INFO nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Took 11.93 seconds to spawn the instance on the hypervisor.
Apr 17 10:34:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:45 user nova-compute[82522]: INFO nova.compute.manager [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Took 12.79 seconds to build instance.
Apr 17 10:34:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.983s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:34:46 user nova-compute[82522]: WARNING nova.compute.manager [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state building and task_state spawning.
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:34:46 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:34:46 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Creating image(s)
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG nova.policy [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '282298df65264595b5d7351066128b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850462faec874544bdc01dd14746d558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.275s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.335s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk 1073741824" returned: 0 in 0.093s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.441s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.216s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Cannot resize image /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'migration_context' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Ensure instance console log exists: /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:34:48 user nova-compute[82522]: WARNING nova.compute.manager [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state building and task_state spawning.
Apr 17 10:34:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727688.721736, 59fd26de-d46e-4f41-91f6-090005a07d99 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:34:48 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] VM Resumed (Lifecycle Event)
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:34:48 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance spawned successfully.
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:48 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727688.7228124, 59fd26de-d46e-4f41-91f6-090005a07d99 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:34:48 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] VM Started (Lifecycle Event)
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:34:48 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:34:48 user nova-compute[82522]: DEBUG nova.network.neutron [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Successfully updated port: cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:34:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquired lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:34:49 user nova-compute[82522]: INFO nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Took 9.74 seconds to spawn the instance on the hypervisor.
Apr 17 10:34:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:34:49 user nova-compute[82522]: INFO nova.compute.manager [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Took 10.63 seconds to build instance.
Apr 17 10:34:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.813s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-changed-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Refreshing instance network info cache due to event network-changed-cd279a0c-99eb-4e32-876e-6d2208cc1db2. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:34:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] Acquiring lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.network.neutron [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updating instance_info_cache with network_info: [{"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Releasing lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance network_info: |[{"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] Acquired lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Refreshing network info cache for port cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Start _get_guest_xml network_info=[{"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:34:50 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:50 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-146173286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-146173286',id=4,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnvtiDTDPjiz0hQ6df6omtPSqLx8cphP5uhCzg3kQ4E0fo/fGmWEtXCk0ZdSSLB3uDiMb6lTel263kG9OXq4VKHzNS8Ca9hU4viwWvpL2VficVcm9xF14aNByKdknbl9g==',key_name='tempest-keypair-850060525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-llggnnwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=c4315753-415c-45cd-b06f-da1e3ccc6e4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.objects.instance [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'pci_devices' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:34:50 user nova-compute[82522]:   <uuid>c4315753-415c-45cd-b06f-da1e3ccc6e4d</uuid>
Apr 17 10:34:50 user nova-compute[82522]:   <name>instance-00000004</name>
Apr 17 10:34:50 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:34:50 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:34:50 user nova-compute[82522]:   <metadata>
Apr 17 10:34:50 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:34:50 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:34:50 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-146173286</nova:name>
Apr 17 10:34:50 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:34:50</nova:creationTime>
Apr 17 10:34:50 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:34:50 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:34:50 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:34:50 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:34:50 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:34:50 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:34:50 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:34:50 user nova-compute[82522]:       <nova:owner>
Apr 17 10:34:50 user nova-compute[82522]:         <nova:user uuid="aea97828312f45ffa1b7148c375a7f9a">tempest-AttachVolumeShelveTestJSON-1174346715-project-member</nova:user>
Apr 17 10:34:50 user nova-compute[82522]:         <nova:project uuid="e6dac880f4294283ae7838bfa0edf5c1">tempest-AttachVolumeShelveTestJSON-1174346715</nova:project>
Apr 17 10:34:50 user nova-compute[82522]:       </nova:owner>
Apr 17 10:34:50 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:34:50 user nova-compute[82522]:       <nova:ports>
Apr 17 10:34:50 user nova-compute[82522]:         <nova:port uuid="cd279a0c-99eb-4e32-876e-6d2208cc1db2">
Apr 17 10:34:50 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:34:50 user nova-compute[82522]:         </nova:port>
Apr 17 10:34:50 user nova-compute[82522]:       </nova:ports>
Apr 17 10:34:50 user nova-compute[82522]:     </nova:instance>
Apr 17 10:34:50 user nova-compute[82522]:   </metadata>
Apr 17 10:34:50 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:34:50 user nova-compute[82522]:     <system>
Apr 17 10:34:50 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:34:50 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:34:50 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:34:50 user nova-compute[82522]:       <entry name="serial">c4315753-415c-45cd-b06f-da1e3ccc6e4d</entry>
Apr 17 10:34:50 user nova-compute[82522]:       <entry name="uuid">c4315753-415c-45cd-b06f-da1e3ccc6e4d</entry>
Apr 17 10:34:50 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:34:50 user nova-compute[82522]:     </system>
Apr 17 10:34:50 user nova-compute[82522]:   </sysinfo>
Apr 17 10:34:50 user nova-compute[82522]:   <os>
Apr 17 10:34:50 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:34:50 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:34:50 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:34:50 user nova-compute[82522]:   </os>
Apr 17 10:34:50 user nova-compute[82522]:   <features>
Apr 17 10:34:50 user nova-compute[82522]:     <acpi/>
Apr 17 10:34:50 user nova-compute[82522]:     <apic/>
Apr 17 10:34:50 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:34:50 user nova-compute[82522]:   </features>
Apr 17 10:34:50 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:34:50 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:34:50 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:34:50 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:34:50 user nova-compute[82522]:   </clock>
Apr 17 10:34:50 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:34:50 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:34:50 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:34:50 user nova-compute[82522]:   </cpu>
Apr 17 10:34:50 user nova-compute[82522]:   <devices>
Apr 17 10:34:50 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:34:50 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:34:50 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk"/>
Apr 17 10:34:50 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:34:50 user nova-compute[82522]:     </disk>
Apr 17 10:34:50 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:34:50 user nova-compute[82522]:       <mac address="fa:16:3e:74:83:7c"/>
Apr 17 10:34:50 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:50 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:34:50 user nova-compute[82522]:       <target dev="tapcd279a0c-99"/>
Apr 17 10:34:50 user nova-compute[82522]:     </interface>
Apr 17 10:34:50 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:34:50 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/console.log" append="off"/>
Apr 17 10:34:50 user nova-compute[82522]:     </serial>
Apr 17 10:34:50 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:34:50 user nova-compute[82522]:     <video>
Apr 17 10:34:50 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:50 user nova-compute[82522]:     </video>
Apr 17 10:34:50 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:34:50 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:34:50 user nova-compute[82522]:     </rng>
Apr 17 10:34:50 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:34:50 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:34:50 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:34:50 user nova-compute[82522]:     </memballoon>
Apr 17 10:34:50 user nova-compute[82522]:   </devices>
Apr 17 10:34:50 user nova-compute[82522]: </domain>
Apr 17 10:34:50 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-146173286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-146173286',id=4,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnvtiDTDPjiz0hQ6df6omtPSqLx8cphP5uhCzg3kQ4E0fo/fGmWEtXCk0ZdSSLB3uDiMb6lTel263kG9OXq4VKHzNS8Ca9hU4viwWvpL2VficVcm9xF14aNByKdknbl9g==',key_name='tempest-keypair-850060525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-llggnnwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=c4315753-415c-45cd-b06f-da1e3ccc6e4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG os_vif [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd279a0c-99, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd279a0c-99, col_values=(('external_ids', {'iface-id': 'cd279a0c-99eb-4e32-876e-6d2208cc1db2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:83:7c', 'vm-uuid': 'c4315753-415c-45cd-b06f-da1e3ccc6e4d'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:34:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:50 user nova-compute[82522]: INFO os_vif [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99')
Apr 17 10:34:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:34:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] No VIF found with MAC fa:16:3e:74:83:7c, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:34:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:51 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Successfully created port: f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:34:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:52 user nova-compute[82522]: DEBUG nova.network.neutron [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updated VIF entry in instance network info cache for port cd279a0c-99eb-4e32-876e-6d2208cc1db2. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:34:52 user nova-compute[82522]: DEBUG nova.network.neutron [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updating instance_info_cache with network_info: [{"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] Releasing lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] No waiting events found dispatching network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:34:53 user nova-compute[82522]: WARNING nova.compute.manager [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received unexpected event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance with vm_state building and task_state spawning.
Apr 17 10:34:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Successfully updated port: f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:34:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquired lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:34:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-changed-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Refreshing instance network info cache due to event network-changed-f839dea5-4294-4842-bfa2-262351dabfb9. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:34:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] Acquiring lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727695.638825, c4315753-415c-45cd-b06f-da1e3ccc6e4d => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:34:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] VM Resumed (Lifecycle Event)
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:34:55 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance spawned successfully.
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:34:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727695.6399567, c4315753-415c-45cd-b06f-da1e3ccc6e4d => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:34:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] VM Started (Lifecycle Event)
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] No waiting events found dispatching network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:34:55 user nova-compute[82522]: WARNING nova.compute.manager [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received unexpected event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance with vm_state building and task_state spawning.
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:34:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:34:55 user nova-compute[82522]: INFO nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Took 14.13 seconds to spawn the instance on the hypervisor.
Apr 17 10:34:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:34:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Releasing lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Instance network_info: |[{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:34:56 user nova-compute[82522]: INFO nova.compute.manager [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Took 15.13 seconds to build instance.
Apr 17 10:34:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] Acquired lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Refreshing network info cache for port f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Start _get_guest_xml network_info=[{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.292s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-149216570',display_name='tempest-ServerStableDeviceRescueTest-server-149216570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-149216570',id=5,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMwn+C+1/WvqV85P8Z+0YbdwvuPA1JRVCsTkMku5wTk3lWyccqRP3BA+GEJxUJW41c3kbKZgFZYKS36Yqqk/bayBcZoFHQqGTKsw0QCKdBNYqIi+SXQR7Q9/idwCJCSQQ==',key_name='tempest-keypair-690522544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850462faec874544bdc01dd14746d558',ramdisk_id='',reservation_id='r-rmln8x19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1756156966',owner_user_name='tempest-ServerStableDeviceRescueTest-1756156966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='282298df65264595b5d7351066128b1a',uuid=e0b1074e-7352-437a-b2ec-1eaefc5bf1b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Converting VIF {"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:c9:94,bridge_name='br-int',has_traffic_filtering=True,id=f839dea5-4294-4842-bfa2-262351dabfb9,network=Network(95203f9a-7934-486d-b36d-13d2317f1102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf839dea5-42') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'pci_devices' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:34:56 user nova-compute[82522]:   <uuid>e0b1074e-7352-437a-b2ec-1eaefc5bf1b4</uuid>
Apr 17 10:34:56 user nova-compute[82522]:   <name>instance-00000005</name>
Apr 17 10:34:56 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:34:56 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:34:56 user nova-compute[82522]:   <metadata>
Apr 17 10:34:56 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:34:56 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:34:56 user nova-compute[82522]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-149216570</nova:name>
Apr 17 10:34:56 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:34:56</nova:creationTime>
Apr 17 10:34:56 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:34:56 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:34:56 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:34:56 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:34:56 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:34:56 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:34:56 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:34:56 user nova-compute[82522]:       <nova:owner>
Apr 17 10:34:56 user nova-compute[82522]:         <nova:user uuid="282298df65264595b5d7351066128b1a">tempest-ServerStableDeviceRescueTest-1756156966-project-member</nova:user>
Apr 17 10:34:56 user nova-compute[82522]:         <nova:project uuid="850462faec874544bdc01dd14746d558">tempest-ServerStableDeviceRescueTest-1756156966</nova:project>
Apr 17 10:34:56 user nova-compute[82522]:       </nova:owner>
Apr 17 10:34:56 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:34:56 user nova-compute[82522]:       <nova:ports>
Apr 17 10:34:56 user nova-compute[82522]:         <nova:port uuid="f839dea5-4294-4842-bfa2-262351dabfb9">
Apr 17 10:34:56 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:34:56 user nova-compute[82522]:         </nova:port>
Apr 17 10:34:56 user nova-compute[82522]:       </nova:ports>
Apr 17 10:34:56 user nova-compute[82522]:     </nova:instance>
Apr 17 10:34:56 user nova-compute[82522]:   </metadata>
Apr 17 10:34:56 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:34:56 user nova-compute[82522]:     <system>
Apr 17 10:34:56 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:34:56 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:34:56 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:34:56 user nova-compute[82522]:       <entry name="serial">e0b1074e-7352-437a-b2ec-1eaefc5bf1b4</entry>
Apr 17 10:34:56 user nova-compute[82522]:       <entry name="uuid">e0b1074e-7352-437a-b2ec-1eaefc5bf1b4</entry>
Apr 17 10:34:56 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:34:56 user nova-compute[82522]:     </system>
Apr 17 10:34:56 user nova-compute[82522]:   </sysinfo>
Apr 17 10:34:56 user nova-compute[82522]:   <os>
Apr 17 10:34:56 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:34:56 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:34:56 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:34:56 user nova-compute[82522]:   </os>
Apr 17 10:34:56 user nova-compute[82522]:   <features>
Apr 17 10:34:56 user nova-compute[82522]:     <acpi/>
Apr 17 10:34:56 user nova-compute[82522]:     <apic/>
Apr 17 10:34:56 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:34:56 user nova-compute[82522]:   </features>
Apr 17 10:34:56 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:34:56 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:34:56 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:34:56 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:34:56 user nova-compute[82522]:   </clock>
Apr 17 10:34:56 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:34:56 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:34:56 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:34:56 user nova-compute[82522]:   </cpu>
Apr 17 10:34:56 user nova-compute[82522]:   <devices>
Apr 17 10:34:56 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:34:56 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:34:56 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk"/>
Apr 17 10:34:56 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:34:56 user nova-compute[82522]:     </disk>
Apr 17 10:34:56 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:34:56 user nova-compute[82522]:       <mac address="fa:16:3e:59:c9:94"/>
Apr 17 10:34:56 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:56 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:34:56 user nova-compute[82522]:       <target dev="tapf839dea5-42"/>
Apr 17 10:34:56 user nova-compute[82522]:     </interface>
Apr 17 10:34:56 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:34:56 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/console.log" append="off"/>
Apr 17 10:34:56 user nova-compute[82522]:     </serial>
Apr 17 10:34:56 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:34:56 user nova-compute[82522]:     <video>
Apr 17 10:34:56 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:34:56 user nova-compute[82522]:     </video>
Apr 17 10:34:56 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:34:56 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:34:56 user nova-compute[82522]:     </rng>
Apr 17 10:34:56 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:34:56 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:34:56 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:34:56 user nova-compute[82522]:     </memballoon>
Apr 17 10:34:56 user nova-compute[82522]:   </devices>
Apr 17 10:34:56 user nova-compute[82522]: </domain>
Apr 17 10:34:56 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-149216570',display_name='tempest-ServerStableDeviceRescueTest-server-149216570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-149216570',id=5,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMwn+C+1/WvqV85P8Z+0YbdwvuPA1JRVCsTkMku5wTk3lWyccqRP3BA+GEJxUJW41c3kbKZgFZYKS36Yqqk/bayBcZoFHQqGTKsw0QCKdBNYqIi+SXQR7Q9/idwCJCSQQ==',key_name='tempest-keypair-690522544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850462faec874544bdc01dd14746d558',ramdisk_id='',reservation_id='r-rmln8x19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1756156966',owner_user_name='tempest-ServerStableDeviceRescueTest-1756156966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='282298df65264595b5d7351066128b1a',uuid=e0b1074e-7352-437a-b2ec-1eaefc5bf1b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Converting VIF {"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:c9:94,bridge_name='br-int',has_traffic_filtering=True,id=f839dea5-4294-4842-bfa2-262351dabfb9,network=Network(95203f9a-7934-486d-b36d-13d2317f1102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf839dea5-42') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG os_vif [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:c9:94,bridge_name='br-int',has_traffic_filtering=True,id=f839dea5-4294-4842-bfa2-262351dabfb9,network=Network(95203f9a-7934-486d-b36d-13d2317f1102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf839dea5-42') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf839dea5-42, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf839dea5-42, col_values=(('external_ids', {'iface-id': 'f839dea5-4294-4842-bfa2-262351dabfb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:c9:94', 'vm-uuid': 'e0b1074e-7352-437a-b2ec-1eaefc5bf1b4'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:56 user nova-compute[82522]: INFO os_vif [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:c9:94,bridge_name='br-int',has_traffic_filtering=True,id=f839dea5-4294-4842-bfa2-262351dabfb9,network=Network(95203f9a-7934-486d-b36d-13d2317f1102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf839dea5-42')
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:34:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] No VIF found with MAC fa:16:3e:59:c9:94, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:34:57 user nova-compute[82522]: DEBUG nova.network.neutron [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updated VIF entry in instance network info cache for port f839dea5-4294-4842-bfa2-262351dabfb9. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:34:57 user nova-compute[82522]: DEBUG nova.network.neutron [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:34:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] Releasing lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:34:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:34:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:34:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:34:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:34:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:34:58 user nova-compute[82522]: WARNING nova.compute.manager [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state building and task_state spawning.
Apr 17 10:34:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:34:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:35:00 user nova-compute[82522]: WARNING nova.compute.manager [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state building and task_state spawning.
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727701.0251293, e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:35:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] VM Resumed (Lifecycle Event)
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:35:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Instance spawned successfully.
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:35:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727701.02769, e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:35:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] VM Started (Lifecycle Event)
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:35:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:35:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Took 14.69 seconds to spawn the instance on the hypervisor.
Apr 17 10:35:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Took 15.77 seconds to build instance.
Apr 17 10:35:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.945s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:35:03 user nova-compute[82522]: INFO nova.compute.claims [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Claim successful on node user
Apr 17 10:35:03 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:35:03 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:35:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:35:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG nova.policy [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c18c3804bb0449c8bba3b56df41ccc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ad2dd86dc14ead939b4fdca5a97a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:35:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Creating image(s)
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "/opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "/opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "/opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.196s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.173s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk 1073741824" returned: 0 in 0.069s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.186s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:35:04 user nova-compute[82522]: INFO nova.compute.claims [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Claim successful on node user
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Cannot resize image /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.objects.instance [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lazy-loading 'migration_context' on Instance uuid 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Ensure instance console log exists: /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Successfully created port: 01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.network.neutron [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:35:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:35:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Creating image(s)
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "/opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "/opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "e33d901a9af14bd0316200c7decc3e350dd2ff03" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "e33d901a9af14bd0316200c7decc3e350dd2ff03" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:05 user nova-compute[82522]: DEBUG nova.policy [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a9df3167c7947aab20f7c2ef837fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50344f2e70ef48de8fbf64d408e61210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Successfully updated port: 01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received event network-changed-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Refreshing instance network info cache due to event network-changed-01527ff5-7a84-4bbf-ae89-ef334a97fc0a. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] Acquiring lock "refresh_cache-3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] Acquired lock "refresh_cache-3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG nova.network.neutron [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Refreshing network info cache for port 01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "refresh_cache-3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03.part --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG nova.virt.images [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] ba2509ee-798b-4a36-b711-51a9b4dc7e2c was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03.part /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG nova.network.neutron [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03.part /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03.converted" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "e33d901a9af14bd0316200c7decc3e350dd2ff03" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.807s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03 --force-share --output=json" returned: 0 in 0.173s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "e33d901a9af14bd0316200c7decc3e350dd2ff03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "e33d901a9af14bd0316200c7decc3e350dd2ff03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03 --force-share --output=json" returned: 0 in 0.163s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03,backing_fmt=raw /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG nova.network.neutron [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03,backing_fmt=raw /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk 1073741824" returned: 0 in 0.057s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "e33d901a9af14bd0316200c7decc3e350dd2ff03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] Releasing lock "refresh_cache-3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquired lock "refresh_cache-3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03 --force-share --output=json" returned: 0 in 0.190s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Cannot resize image /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.objects.instance [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lazy-loading 'migration_context' on Instance uuid 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Ensure instance console log exists: /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Updating instance_info_cache with network_info: [{"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Releasing lock "refresh_cache-3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Instance network_info: |[{"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Start _get_guest_xml network_info=[{"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:35:07 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:07 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-450067832',display_name='tempest-TestVolumeSwap-server-450067832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-450067832',id=6,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKwzN5gZwJiLf7kL/Te58BS/o4Hp6lTpWXkF6oFUo6Fvuvh0VO0qHyTu9Tnn1hT7l4fXP9wTcKvNBSlIqYvAeBr+B6hcdfu7buddRuJa0QtQHU7hZJ7nWicTq8L7ShjNw==',key_name='tempest-keypair-1885421127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ad2dd86dc14ead939b4fdca5a97a35',ramdisk_id='',reservation_id='r-wfpfga1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1885282809',owner_user_name='tempest-TestVolumeSwap-1885282809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18c3804bb0449c8bba3b56df41ccc99',uuid=3336cde8-eedb-4d3e-8c20-b79cd2d1f51d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Converting VIF {"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:19,bridge_name='br-int',has_traffic_filtering=True,id=01527ff5-7a84-4bbf-ae89-ef334a97fc0a,network=Network(25db3f74-3642-482d-8c0d-667e3cdf4e3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01527ff5-7a') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.objects.instance [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lazy-loading 'pci_devices' on Instance uuid 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:35:07 user nova-compute[82522]:   <uuid>3336cde8-eedb-4d3e-8c20-b79cd2d1f51d</uuid>
Apr 17 10:35:07 user nova-compute[82522]:   <name>instance-00000006</name>
Apr 17 10:35:07 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:35:07 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:35:07 user nova-compute[82522]:   <metadata>
Apr 17 10:35:07 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:35:07 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:35:07 user nova-compute[82522]:       <nova:name>tempest-TestVolumeSwap-server-450067832</nova:name>
Apr 17 10:35:07 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:35:07</nova:creationTime>
Apr 17 10:35:07 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:35:07 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:35:07 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:35:07 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:35:07 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:35:07 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:35:07 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:35:07 user nova-compute[82522]:       <nova:owner>
Apr 17 10:35:07 user nova-compute[82522]:         <nova:user uuid="c18c3804bb0449c8bba3b56df41ccc99">tempest-TestVolumeSwap-1885282809-project-member</nova:user>
Apr 17 10:35:07 user nova-compute[82522]:         <nova:project uuid="74ad2dd86dc14ead939b4fdca5a97a35">tempest-TestVolumeSwap-1885282809</nova:project>
Apr 17 10:35:07 user nova-compute[82522]:       </nova:owner>
Apr 17 10:35:07 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:35:07 user nova-compute[82522]:       <nova:ports>
Apr 17 10:35:07 user nova-compute[82522]:         <nova:port uuid="01527ff5-7a84-4bbf-ae89-ef334a97fc0a">
Apr 17 10:35:07 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 17 10:35:07 user nova-compute[82522]:         </nova:port>
Apr 17 10:35:07 user nova-compute[82522]:       </nova:ports>
Apr 17 10:35:07 user nova-compute[82522]:     </nova:instance>
Apr 17 10:35:07 user nova-compute[82522]:   </metadata>
Apr 17 10:35:07 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:35:07 user nova-compute[82522]:     <system>
Apr 17 10:35:07 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:35:07 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:35:07 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:35:07 user nova-compute[82522]:       <entry name="serial">3336cde8-eedb-4d3e-8c20-b79cd2d1f51d</entry>
Apr 17 10:35:07 user nova-compute[82522]:       <entry name="uuid">3336cde8-eedb-4d3e-8c20-b79cd2d1f51d</entry>
Apr 17 10:35:07 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:35:07 user nova-compute[82522]:     </system>
Apr 17 10:35:07 user nova-compute[82522]:   </sysinfo>
Apr 17 10:35:07 user nova-compute[82522]:   <os>
Apr 17 10:35:07 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:35:07 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:35:07 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:35:07 user nova-compute[82522]:   </os>
Apr 17 10:35:07 user nova-compute[82522]:   <features>
Apr 17 10:35:07 user nova-compute[82522]:     <acpi/>
Apr 17 10:35:07 user nova-compute[82522]:     <apic/>
Apr 17 10:35:07 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:35:07 user nova-compute[82522]:   </features>
Apr 17 10:35:07 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:35:07 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:35:07 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:35:07 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:35:07 user nova-compute[82522]:   </clock>
Apr 17 10:35:07 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:35:07 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:35:07 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:35:07 user nova-compute[82522]:   </cpu>
Apr 17 10:35:07 user nova-compute[82522]:   <devices>
Apr 17 10:35:07 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:35:07 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:35:07 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk"/>
Apr 17 10:35:07 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:35:07 user nova-compute[82522]:     </disk>
Apr 17 10:35:07 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:35:07 user nova-compute[82522]:       <mac address="fa:16:3e:f5:52:19"/>
Apr 17 10:35:07 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:35:07 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:35:07 user nova-compute[82522]:       <target dev="tap01527ff5-7a"/>
Apr 17 10:35:07 user nova-compute[82522]:     </interface>
Apr 17 10:35:07 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:35:07 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/console.log" append="off"/>
Apr 17 10:35:07 user nova-compute[82522]:     </serial>
Apr 17 10:35:07 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:35:07 user nova-compute[82522]:     <video>
Apr 17 10:35:07 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:35:07 user nova-compute[82522]:     </video>
Apr 17 10:35:07 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:35:07 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:35:07 user nova-compute[82522]:     </rng>
Apr 17 10:35:07 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:35:07 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:35:07 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:35:07 user nova-compute[82522]:     </memballoon>
Apr 17 10:35:07 user nova-compute[82522]:   </devices>
Apr 17 10:35:07 user nova-compute[82522]: </domain>
Apr 17 10:35:07 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-450067832',display_name='tempest-TestVolumeSwap-server-450067832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-450067832',id=6,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKwzN5gZwJiLf7kL/Te58BS/o4Hp6lTpWXkF6oFUo6Fvuvh0VO0qHyTu9Tnn1hT7l4fXP9wTcKvNBSlIqYvAeBr+B6hcdfu7buddRuJa0QtQHU7hZJ7nWicTq8L7ShjNw==',key_name='tempest-keypair-1885421127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ad2dd86dc14ead939b4fdca5a97a35',ramdisk_id='',reservation_id='r-wfpfga1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1885282809',owner_user_name='tempest-TestVolumeSwap-1885282809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18c3804bb0449c8bba3b56df41ccc99',uuid=3336cde8-eedb-4d3e-8c20-b79cd2d1f51d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Converting VIF {"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:19,bridge_name='br-int',has_traffic_filtering=True,id=01527ff5-7a84-4bbf-ae89-ef334a97fc0a,network=Network(25db3f74-3642-482d-8c0d-667e3cdf4e3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01527ff5-7a') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG os_vif [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:19,bridge_name='br-int',has_traffic_filtering=True,id=01527ff5-7a84-4bbf-ae89-ef334a97fc0a,network=Network(25db3f74-3642-482d-8c0d-667e3cdf4e3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01527ff5-7a') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01527ff5-7a, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01527ff5-7a, col_values=(('external_ids', {'iface-id': '01527ff5-7a84-4bbf-ae89-ef334a97fc0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:52:19', 'vm-uuid': '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:07 user nova-compute[82522]: INFO os_vif [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:52:19,bridge_name='br-int',has_traffic_filtering=True,id=01527ff5-7a84-4bbf-ae89-ef334a97fc0a,network=Network(25db3f74-3642-482d-8c0d-667e3cdf4e3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01527ff5-7a')
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Successfully created port: 6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:35:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] No VIF found with MAC fa:16:3e:f5:52:19, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:35:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG nova.network.neutron [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Successfully updated port: 6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "refresh_cache-5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquired lock "refresh_cache-5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG nova.network.neutron [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received event network-changed-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Refreshing instance network info cache due to event network-changed-6289bf49-e33d-4ce9-bac7-376417d7abb8. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] Acquiring lock "refresh_cache-5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG nova.network.neutron [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.network.neutron [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Updating instance_info_cache with network_info: [{"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Releasing lock "refresh_cache-5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Instance network_info: |[{"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] Acquired lock "refresh_cache-5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.network.neutron [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Refreshing network info cache for port 6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Start _get_guest_xml network_info=[{"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:34:56Z,direct_url=<?>,disk_format='qcow2',id=ba2509ee-798b-4a36-b711-51a9b4dc7e2c,min_disk=0,min_ram=0,name='',owner='bb70e6d656a24fc68b000bcc3b0cf692',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:35:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/sda', 'encryption_format': None, 'encrypted': False, 'image_id': 'ba2509ee-798b-4a36-b711-51a9b4dc7e2c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:35:10 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:10 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:34:56Z,direct_url=<?>,disk_format='qcow2',id=ba2509ee-798b-4a36-b711-51a9b4dc7e2c,min_disk=0,min_ram=0,name='',owner='bb70e6d656a24fc68b000bcc3b0cf692',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:35:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-341764488',display_name='tempest-AttachSCSIVolumeTestJSON-server-341764488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-341764488',id=7,image_ref='ba2509ee-798b-4a36-b711-51a9b4dc7e2c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqZ/L6Z2Kpu64fEasPk05MYgGtpWeDJ254P2nPv61ccoonFszcT+uOvzrkLkO3pDSfAypS69UN5RLH0LaeaUpvK1JdPPzFtcQDbiz2XV5NbfAUmtLuHYK+SIu/wbWz9zw==',key_name='tempest-keypair-2120973316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50344f2e70ef48de8fbf64d408e61210',ramdisk_id='',reservation_id='r-arqfenpq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ba2509ee-798b-4a36-b711-51a9b4dc7e2c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1369167370',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1369167370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a9df3167c7947aab20f7c2ef837fe92',uuid=5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Converting VIF {"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=6289bf49-e33d-4ce9-bac7-376417d7abb8,network=Network(c223b63d-e8a2-4312-ab68-1bec24248b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6289bf49-e3') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.objects.instance [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:35:10 user nova-compute[82522]:   <uuid>5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab</uuid>
Apr 17 10:35:10 user nova-compute[82522]:   <name>instance-00000007</name>
Apr 17 10:35:10 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:35:10 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:35:10 user nova-compute[82522]:   <metadata>
Apr 17 10:35:10 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:35:10 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:35:10 user nova-compute[82522]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-341764488</nova:name>
Apr 17 10:35:10 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:35:10</nova:creationTime>
Apr 17 10:35:10 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:35:10 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:35:10 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:35:10 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:35:10 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:35:10 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:35:10 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:35:10 user nova-compute[82522]:       <nova:owner>
Apr 17 10:35:10 user nova-compute[82522]:         <nova:user uuid="1a9df3167c7947aab20f7c2ef837fe92">tempest-AttachSCSIVolumeTestJSON-1369167370-project-member</nova:user>
Apr 17 10:35:10 user nova-compute[82522]:         <nova:project uuid="50344f2e70ef48de8fbf64d408e61210">tempest-AttachSCSIVolumeTestJSON-1369167370</nova:project>
Apr 17 10:35:10 user nova-compute[82522]:       </nova:owner>
Apr 17 10:35:10 user nova-compute[82522]:       <nova:root type="image" uuid="ba2509ee-798b-4a36-b711-51a9b4dc7e2c"/>
Apr 17 10:35:10 user nova-compute[82522]:       <nova:ports>
Apr 17 10:35:10 user nova-compute[82522]:         <nova:port uuid="6289bf49-e33d-4ce9-bac7-376417d7abb8">
Apr 17 10:35:10 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 10:35:10 user nova-compute[82522]:         </nova:port>
Apr 17 10:35:10 user nova-compute[82522]:       </nova:ports>
Apr 17 10:35:10 user nova-compute[82522]:     </nova:instance>
Apr 17 10:35:10 user nova-compute[82522]:   </metadata>
Apr 17 10:35:10 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:35:10 user nova-compute[82522]:     <system>
Apr 17 10:35:10 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:35:10 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:35:10 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:35:10 user nova-compute[82522]:       <entry name="serial">5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab</entry>
Apr 17 10:35:10 user nova-compute[82522]:       <entry name="uuid">5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab</entry>
Apr 17 10:35:10 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:35:10 user nova-compute[82522]:     </system>
Apr 17 10:35:10 user nova-compute[82522]:   </sysinfo>
Apr 17 10:35:10 user nova-compute[82522]:   <os>
Apr 17 10:35:10 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:35:10 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:35:10 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:35:10 user nova-compute[82522]:   </os>
Apr 17 10:35:10 user nova-compute[82522]:   <features>
Apr 17 10:35:10 user nova-compute[82522]:     <acpi/>
Apr 17 10:35:10 user nova-compute[82522]:     <apic/>
Apr 17 10:35:10 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:35:10 user nova-compute[82522]:   </features>
Apr 17 10:35:10 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:35:10 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:35:10 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:35:10 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:35:10 user nova-compute[82522]:   </clock>
Apr 17 10:35:10 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:35:10 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:35:10 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:35:10 user nova-compute[82522]:   </cpu>
Apr 17 10:35:10 user nova-compute[82522]:   <devices>
Apr 17 10:35:10 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:35:10 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:35:10 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk"/>
Apr 17 10:35:10 user nova-compute[82522]:       <target dev="sda" bus="scsi"/>
Apr 17 10:35:10 user nova-compute[82522]:       <address type="drive" controller="0" unit="0"/>
Apr 17 10:35:10 user nova-compute[82522]:     </disk>
Apr 17 10:35:10 user nova-compute[82522]:     <disk type="file" device="cdrom">
Apr 17 10:35:10 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none"/>
Apr 17 10:35:10 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk.config"/>
Apr 17 10:35:10 user nova-compute[82522]:       <target dev="sdb" bus="scsi"/>
Apr 17 10:35:10 user nova-compute[82522]:       <address type="drive" controller="0" unit="1"/>
Apr 17 10:35:10 user nova-compute[82522]:     </disk>
Apr 17 10:35:10 user nova-compute[82522]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 17 10:35:10 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:35:10 user nova-compute[82522]:       <mac address="fa:16:3e:b1:ee:b8"/>
Apr 17 10:35:10 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:35:10 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:35:10 user nova-compute[82522]:       <target dev="tap6289bf49-e3"/>
Apr 17 10:35:10 user nova-compute[82522]:     </interface>
Apr 17 10:35:10 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:35:10 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/console.log" append="off"/>
Apr 17 10:35:10 user nova-compute[82522]:     </serial>
Apr 17 10:35:10 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:35:10 user nova-compute[82522]:     <video>
Apr 17 10:35:10 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:35:10 user nova-compute[82522]:     </video>
Apr 17 10:35:10 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:35:10 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:35:10 user nova-compute[82522]:     </rng>
Apr 17 10:35:10 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:35:10 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:35:10 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:35:10 user nova-compute[82522]:     </memballoon>
Apr 17 10:35:10 user nova-compute[82522]:   </devices>
Apr 17 10:35:10 user nova-compute[82522]: </domain>
Apr 17 10:35:10 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-341764488',display_name='tempest-AttachSCSIVolumeTestJSON-server-341764488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-341764488',id=7,image_ref='ba2509ee-798b-4a36-b711-51a9b4dc7e2c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqZ/L6Z2Kpu64fEasPk05MYgGtpWeDJ254P2nPv61ccoonFszcT+uOvzrkLkO3pDSfAypS69UN5RLH0LaeaUpvK1JdPPzFtcQDbiz2XV5NbfAUmtLuHYK+SIu/wbWz9zw==',key_name='tempest-keypair-2120973316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50344f2e70ef48de8fbf64d408e61210',ramdisk_id='',reservation_id='r-arqfenpq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ba2509ee-798b-4a36-b711-51a9b4dc7e2c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1369167370',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1369167370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a9df3167c7947aab20f7c2ef837fe92',uuid=5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Converting VIF {"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=6289bf49-e33d-4ce9-bac7-376417d7abb8,network=Network(c223b63d-e8a2-4312-ab68-1bec24248b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6289bf49-e3') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG os_vif [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=6289bf49-e33d-4ce9-bac7-376417d7abb8,network=Network(c223b63d-e8a2-4312-ab68-1bec24248b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6289bf49-e3') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6289bf49-e3, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6289bf49-e3, col_values=(('external_ids', {'iface-id': '6289bf49-e33d-4ce9-bac7-376417d7abb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:ee:b8', 'vm-uuid': '5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:35:10 user nova-compute[82522]: INFO os_vif [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=6289bf49-e33d-4ce9-bac7-376417d7abb8,network=Network(c223b63d-e8a2-4312-ab68-1bec24248b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6289bf49-e3')
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] No BDM found with device name sda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] No VIF found with MAC fa:16:3e:b1:ee:b8, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:35:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Using config drive
Apr 17 10:35:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Creating config drive at /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk.config
Apr 17 10:35:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcop3m9s0 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcop3m9s0" returned: 0 in 0.068s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG nova.network.neutron [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Updated VIF entry in instance network info cache for port 6289bf49-e33d-4ce9-bac7-376417d7abb8. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG nova.network.neutron [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Updating instance_info_cache with network_info: [{"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] Releasing lock "refresh_cache-5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received event network-vif-plugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] No waiting events found dispatching network-vif-plugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:35:11 user nova-compute[82522]: WARNING nova.compute.manager [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received unexpected event network-vif-plugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance with vm_state building and task_state spawning.
Apr 17 10:35:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received event network-vif-plugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] No waiting events found dispatching network-vif-plugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:35:11 user nova-compute[82522]: WARNING nova.compute.manager [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received unexpected event network-vif-plugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance with vm_state building and task_state spawning.
Apr 17 10:35:11 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727711.9904914, 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:35:11 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] VM Resumed (Lifecycle Event)
Apr 17 10:35:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:35:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:35:12 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Instance spawned successfully.
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:35:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727711.9970453, 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:35:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] VM Started (Lifecycle Event)
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Skipping network cache update for instance because it is Building. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Skipping network cache update for instance because it is Building. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 17 10:35:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:35:12 user nova-compute[82522]: INFO nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Took 7.89 seconds to spawn the instance on the hypervisor.
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:12 user nova-compute[82522]: INFO nova.compute.manager [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Took 8.93 seconds to build instance.
Apr 17 10:35:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 60008675-7786-4a26-9640-49da6efd0adb {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.241s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received event network-vif-plugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] No waiting events found dispatching network-vif-plugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:35:12 user nova-compute[82522]: WARNING nova.compute.manager [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received unexpected event network-vif-plugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance with vm_state building and task_state spawning.
Apr 17 10:35:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:13 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updating instance_info_cache with network_info: [{"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:13 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:35:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received event network-vif-plugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] No waiting events found dispatching network-vif-plugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:35:14 user nova-compute[82522]: WARNING nova.compute.manager [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received unexpected event network-vif-plugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance with vm_state building and task_state spawning.
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727714.8290222, 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:35:14 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] VM Resumed (Lifecycle Event)
Apr 17 10:35:14 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Instance spawned successfully.
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:35:14 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727714.8292289, 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:35:14 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] VM Started (Lifecycle Event)
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:14 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:35:15 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:35:15 user nova-compute[82522]: INFO nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Took 9.32 seconds to spawn the instance on the hypervisor.
Apr 17 10:35:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:15 user nova-compute[82522]: INFO nova.compute.manager [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Took 10.41 seconds to build instance.
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.581s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:15 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:18 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:18 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=7980MB free_disk=26.814571380615234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 59fd26de-d46e-4f41-91f6-090005a07d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 10:35:18 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 10:35:19 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 10:35:19 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 10:35:19 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:35:19 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:35:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:35:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.037s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:35:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:35:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:24 user nova-compute[82522]: DEBUG nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:35:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:24 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:35:24 user nova-compute[82522]: INFO nova.compute.claims [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Claim successful on node user
Apr 17 10:35:24 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:35:24 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG nova.network.neutron [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:35:25 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:35:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG nova.policy [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea177954e75a45f7ad7c9831ab55375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0c657dc95549a3a3ce94f35bfa91be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:35:25 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Creating image(s)
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "/opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "/opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "/opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.205s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.158s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk 1073741824" returned: 0 in 0.053s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.157s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:35:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:26 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Cannot resize image /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:35:26 user nova-compute[82522]: DEBUG nova.objects.instance [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'migration_context' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:35:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:35:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Ensure instance console log exists: /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:35:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:26 user nova-compute[82522]: DEBUG nova.network.neutron [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Successfully created port: 7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Successfully updated port: 7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquired lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-changed-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Refreshing instance network info cache due to event network-changed-7d50333e-fed3-47d0-9aaf-bd1ab7238d62. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] Acquiring lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating instance_info_cache with network_info: [{"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Releasing lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Instance network_info: |[{"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] Acquired lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.network.neutron [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Refreshing network info cache for port 7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Start _get_guest_xml network_info=[{"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:35:28 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:28 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-3983057',display_name='tempest-SnapshotDataIntegrityTests-server-3983057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-3983057',id=8,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUy/ajstR9aQT2gkuOvucvRJeGg6vK7qK026KNm5Gtty8ym+LC1rRh/ZX81MNLHA7IhoKTr9dTq2LhqisMnOl79ug8UDsCxHekgGAl/F8lBsqTKCw+eY6QDhUlNTWsIWA==',key_name='tempest-SnapshotDataIntegrityTests-645097723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df0c657dc95549a3a3ce94f35bfa91be',ramdisk_id='',reservation_id='r-8auanuyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1852888110',owner_user_name='tempest-SnapshotDataIntegrityTests-1852888110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:25Z,user_data=None,user_id='ea177954e75a45f7ad7c9831ab55375a',uuid=7792cf72-dc73-4201-9501-4515ce860735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Converting VIF {"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:93,bridge_name='br-int',has_traffic_filtering=True,id=7d50333e-fed3-47d0-9aaf-bd1ab7238d62,network=Network(048217be-c7b8-4f65-a379-f4a8f0f18055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d50333e-fe') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.objects.instance [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'pci_devices' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:35:28 user nova-compute[82522]:   <uuid>7792cf72-dc73-4201-9501-4515ce860735</uuid>
Apr 17 10:35:28 user nova-compute[82522]:   <name>instance-00000008</name>
Apr 17 10:35:28 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:35:28 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:35:28 user nova-compute[82522]:   <metadata>
Apr 17 10:35:28 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:35:28 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:35:28 user nova-compute[82522]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-3983057</nova:name>
Apr 17 10:35:28 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:35:28</nova:creationTime>
Apr 17 10:35:28 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:35:28 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:35:28 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:35:28 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:35:28 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:35:28 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:35:28 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:35:28 user nova-compute[82522]:       <nova:owner>
Apr 17 10:35:28 user nova-compute[82522]:         <nova:user uuid="ea177954e75a45f7ad7c9831ab55375a">tempest-SnapshotDataIntegrityTests-1852888110-project-member</nova:user>
Apr 17 10:35:28 user nova-compute[82522]:         <nova:project uuid="df0c657dc95549a3a3ce94f35bfa91be">tempest-SnapshotDataIntegrityTests-1852888110</nova:project>
Apr 17 10:35:28 user nova-compute[82522]:       </nova:owner>
Apr 17 10:35:28 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:35:28 user nova-compute[82522]:       <nova:ports>
Apr 17 10:35:28 user nova-compute[82522]:         <nova:port uuid="7d50333e-fed3-47d0-9aaf-bd1ab7238d62">
Apr 17 10:35:28 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 10:35:28 user nova-compute[82522]:         </nova:port>
Apr 17 10:35:28 user nova-compute[82522]:       </nova:ports>
Apr 17 10:35:28 user nova-compute[82522]:     </nova:instance>
Apr 17 10:35:28 user nova-compute[82522]:   </metadata>
Apr 17 10:35:28 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:35:28 user nova-compute[82522]:     <system>
Apr 17 10:35:28 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:35:28 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:35:28 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:35:28 user nova-compute[82522]:       <entry name="serial">7792cf72-dc73-4201-9501-4515ce860735</entry>
Apr 17 10:35:28 user nova-compute[82522]:       <entry name="uuid">7792cf72-dc73-4201-9501-4515ce860735</entry>
Apr 17 10:35:28 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:35:28 user nova-compute[82522]:     </system>
Apr 17 10:35:28 user nova-compute[82522]:   </sysinfo>
Apr 17 10:35:28 user nova-compute[82522]:   <os>
Apr 17 10:35:28 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:35:28 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:35:28 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:35:28 user nova-compute[82522]:   </os>
Apr 17 10:35:28 user nova-compute[82522]:   <features>
Apr 17 10:35:28 user nova-compute[82522]:     <acpi/>
Apr 17 10:35:28 user nova-compute[82522]:     <apic/>
Apr 17 10:35:28 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:35:28 user nova-compute[82522]:   </features>
Apr 17 10:35:28 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:35:28 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:35:28 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:35:28 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:35:28 user nova-compute[82522]:   </clock>
Apr 17 10:35:28 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:35:28 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:35:28 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:35:28 user nova-compute[82522]:   </cpu>
Apr 17 10:35:28 user nova-compute[82522]:   <devices>
Apr 17 10:35:28 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:35:28 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:35:28 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk"/>
Apr 17 10:35:28 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:35:28 user nova-compute[82522]:     </disk>
Apr 17 10:35:28 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:35:28 user nova-compute[82522]:       <mac address="fa:16:3e:f8:08:93"/>
Apr 17 10:35:28 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:35:28 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:35:28 user nova-compute[82522]:       <target dev="tap7d50333e-fe"/>
Apr 17 10:35:28 user nova-compute[82522]:     </interface>
Apr 17 10:35:28 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:35:28 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/console.log" append="off"/>
Apr 17 10:35:28 user nova-compute[82522]:     </serial>
Apr 17 10:35:28 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:35:28 user nova-compute[82522]:     <video>
Apr 17 10:35:28 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:35:28 user nova-compute[82522]:     </video>
Apr 17 10:35:28 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:35:28 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:35:28 user nova-compute[82522]:     </rng>
Apr 17 10:35:28 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:35:28 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:35:28 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:35:28 user nova-compute[82522]:     </memballoon>
Apr 17 10:35:28 user nova-compute[82522]:   </devices>
Apr 17 10:35:28 user nova-compute[82522]: </domain>
Apr 17 10:35:28 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-3983057',display_name='tempest-SnapshotDataIntegrityTests-server-3983057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-3983057',id=8,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUy/ajstR9aQT2gkuOvucvRJeGg6vK7qK026KNm5Gtty8ym+LC1rRh/ZX81MNLHA7IhoKTr9dTq2LhqisMnOl79ug8UDsCxHekgGAl/F8lBsqTKCw+eY6QDhUlNTWsIWA==',key_name='tempest-SnapshotDataIntegrityTests-645097723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df0c657dc95549a3a3ce94f35bfa91be',ramdisk_id='',reservation_id='r-8auanuyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1852888110',owner_user_name='tempest-SnapshotDataIntegrityTests-1852888110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:25Z,user_data=None,user_id='ea177954e75a45f7ad7c9831ab55375a',uuid=7792cf72-dc73-4201-9501-4515ce860735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Converting VIF {"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:93,bridge_name='br-int',has_traffic_filtering=True,id=7d50333e-fed3-47d0-9aaf-bd1ab7238d62,network=Network(048217be-c7b8-4f65-a379-f4a8f0f18055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d50333e-fe') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG os_vif [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:93,bridge_name='br-int',has_traffic_filtering=True,id=7d50333e-fed3-47d0-9aaf-bd1ab7238d62,network=Network(048217be-c7b8-4f65-a379-f4a8f0f18055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d50333e-fe') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d50333e-fe, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d50333e-fe, col_values=(('external_ids', {'iface-id': '7d50333e-fed3-47d0-9aaf-bd1ab7238d62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:08:93', 'vm-uuid': '7792cf72-dc73-4201-9501-4515ce860735'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:35:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:28 user nova-compute[82522]: INFO os_vif [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:93,bridge_name='br-int',has_traffic_filtering=True,id=7d50333e-fed3-47d0-9aaf-bd1ab7238d62,network=Network(048217be-c7b8-4f65-a379-f4a8f0f18055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d50333e-fe')
Apr 17 10:35:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:35:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No VIF found with MAC fa:16:3e:f8:08:93, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:35:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updated VIF entry in instance network info cache for port 7d50333e-fed3-47d0-9aaf-bd1ab7238d62. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:35:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating instance_info_cache with network_info: [{"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] Releasing lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] No waiting events found dispatching network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:35:30 user nova-compute[82522]: WARNING nova.compute.manager [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received unexpected event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance with vm_state building and task_state spawning.
Apr 17 10:35:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727732.7267675, 7792cf72-dc73-4201-9501-4515ce860735 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:35:32 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] VM Resumed (Lifecycle Event)
Apr 17 10:35:32 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Instance spawned successfully.
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:35:32 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727732.728127, 7792cf72-dc73-4201-9501-4515ce860735 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:35:32 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] VM Started (Lifecycle Event)
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] No waiting events found dispatching network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:35:32 user nova-compute[82522]: WARNING nova.compute.manager [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received unexpected event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance with vm_state building and task_state spawning.
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:35:32 user nova-compute[82522]: INFO nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Took 7.54 seconds to spawn the instance on the hypervisor.
Apr 17 10:35:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:35:32 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:35:32 user nova-compute[82522]: INFO nova.compute.manager [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Took 8.41 seconds to build instance.
Apr 17 10:35:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.573s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:35:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:35:36 user nova-compute[82522]: INFO nova.compute.claims [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Claim successful on node user
Apr 17 10:35:36 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:35:36 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:35:37 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:35:37 user nova-compute[82522]: INFO nova.virt.block_device [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Booting with volume 9c283ca4-fc93-4f5f-ba1d-3190871dea02 at /dev/vda
Apr 17 10:35:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG os_brick.utils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:37 user nova-compute[82522]: INFO oslo.privsep.daemon [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpgn8pm4q3/privsep.sock']
Apr 17 10:35:37 user sudo[92649]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpgn8pm4q3/privsep.sock
Apr 17 10:35:37 user sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.policy [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:35:37 user nova-compute[82522]: INFO nova.compute.claims [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Claim successful on node user
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:35:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:35:38 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:35:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:35:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:35:38 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully created port: 4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:38 user nova-compute[82522]: INFO nova.virt.block_device [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Booting with volume 1b078c60-dd3a-40a5-b5cf-61f0546b7021 at /dev/vda
Apr 17 10:35:38 user nova-compute[82522]: DEBUG nova.policy [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:35:38 user nova-compute[82522]: DEBUG os_brick.utils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:38 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully created port: 0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:39 user nova-compute[82522]: INFO oslo.privsep.daemon [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Spawned new privsep daemon via rootwrap
Apr 17 10:35:39 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 17 10:35:39 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 17 10:35:39 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 17 10:35:39 user nova-compute[82522]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92652
Apr 17 10:35:39 user sudo[92649]: pam_unix(sudo:session): session closed for user root
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3bed14-57ef-4bf3-968b-3b4fe89fe131]: (2,) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: WARNING oslo_privsep.priv_context [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] privsep daemon already running
Apr 17 10:35:39 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully created port: acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[435b68ea-0953-4f29-bbb1-8fb2b4e2abb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc6742-a21b-471b-83f1-4f3e1b178dbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: WARNING os_brick.initiator.connectors.nvmeof [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f1f7c5-16cf-4628-a422-ddf4d3dfdc28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fe462e-d34c-4d6b-a381-d06ae9fbfefb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ba438e-e0bc-4b3a-a874-b1a18f2cefac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c736d6-7a14-4b21-8067-8b68596b9e3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef617192-ee3f-43c6-bc73-cece9de830d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b552039-ea9c-4900-b5fd-8b19e3d014aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:39 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[083e493d-dfd0-4a30-81e9-b96de7638603]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.utils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] <== get_connector_properties: return (2098ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating existing volume attachment record: 1c2df823-84bc-400c-bc36-2b0261d669a7 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:39 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:35:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7726a600-6b88-41d5-8ce0-3ea0b613b0d0]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG os_brick.utils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] <== get_connector_properties: return (1224ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating existing volume attachment record: f5d78f3b-26e1-4335-845d-4f398706ee30 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully created port: c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:39 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully created port: 74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully created port: b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully created port: 2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully created port: 9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully created port: d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully updated port: 4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully created port: 552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:35:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-changed-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing instance network info cache due to event network-changed-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] Acquiring lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] Acquired lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:41 user nova-compute[82522]: DEBUG nova.network.neutron [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing network info cache for port 4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully updated port: 03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully updated port: acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-changed-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing instance network info cache due to event network-changed-acaf0b67-4938-4a01-ac74-86f0935046eb. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] Acquiring lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] Acquired lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing network info cache for port acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] Releasing lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG nova.network.neutron [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] Releasing lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully updated port: 77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully updated port: 5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-changed-03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing instance network info cache due to event network-changed-03ae70e4-ee40-4b09-a38b-a819ee74d880. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Acquiring lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Acquired lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:43 user nova-compute[82522]: DEBUG nova.network.neutron [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing network info cache for port 03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully updated port: 0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Releasing lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-changed-77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing instance network info cache due to event network-changed-77da47f6-f251-457d-b4c9-a2687922abc5. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Acquiring lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Acquired lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing network info cache for port 77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully updated port: b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-changed-5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing instance network info cache due to event network-changed-5ead9709-8869-4070-81f0-1e397c5ba789. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Acquiring lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Acquired lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing network info cache for port 5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Releasing lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:45 user nova-compute[82522]: INFO nova.virt.block_device [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Booting with volume 2e23bb78-786c-40bf-abd6-6ab77d4ed569 at /dev/vdb
Apr 17 10:35:45 user nova-compute[82522]: DEBUG os_brick.utils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab92f03-db86-4bff-93cb-f75d503478d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba0549-0d1c-426c-807a-97b329acea82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dab4c52-8801-4176-9e01-3c4827f39975]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ed0c36-cc3a-47b1-b765-7e941c79c53f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:45 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba3a44-0c4d-4c8b-9313-93caee904464]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG os_brick.utils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating existing volume attachment record: e3a87c8d-52c5-4c8b-bfe5-d4341b45bcc1 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully updated port: c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Releasing lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-changed-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing instance network info cache due to event network-changed-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Acquiring lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Acquired lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing network info cache for port b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully updated port: 74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Releasing lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-changed-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing instance network info cache due to event network-changed-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Acquiring lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Acquired lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing network info cache for port 0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully updated port: 2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:46 user nova-compute[82522]: INFO nova.virt.block_device [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Booting with volume 46647c48-1076-472f-90b1-7e19985bfa7e at /dev/vdb
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG os_brick.utils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9260300d-97b3-4945-aeb6-3f1b8d3372b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08f7afa-27c1-4987-a74e-088a60ed9bc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ba707-e093-4b4d-9267-d2f560f7effa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fc83cc-d059-4e64-910b-1c1ccd70d769]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:46 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f08d41-721b-4cbb-a1eb-e057777e1832]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG os_brick.utils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating existing volume attachment record: ae9a5c04-4b2f-4878-897d-f9afb9f2e278 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully updated port: b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Releasing lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-changed-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing instance network info cache due to event network-changed-c3988098-5dbd-47e1-896c-6a2b6415f64d. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Acquiring lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Acquired lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing network info cache for port c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-changed-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing instance network info cache due to event network-changed-74fde78e-82b3-43f3-9c87-2b754a4bd66f. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Acquiring lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Acquired lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing network info cache for port 74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Releasing lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Successfully updated port: 9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquired lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.compute.manager [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-changed-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.compute.manager [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing instance network info cache due to event network-changed-9df6de54-e8fe-425b-a344-de73c3cc5d3e. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] Acquiring lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.network.neutron [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully updated port: d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Releasing lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.compute.manager [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-changed-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.compute.manager [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing instance network info cache due to event network-changed-b3872258-192d-4118-b77a-98dee0f21115. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Acquiring lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Acquired lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.network.neutron [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing network info cache for port b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:47 user nova-compute[82522]: DEBUG nova.network.neutron [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-changed-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing instance network info cache due to event network-changed-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] Acquiring lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Successfully updated port: 552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG nova.network.neutron [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Releasing lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquired lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-changed-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing instance network info cache due to event network-changed-d6c1ba60-17a7-41b4-85df-afed37da4170. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Acquiring lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:50 user nova-compute[82522]: INFO nova.virt.block_device [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Booting with volume 7fb93d4e-544e-4909-9b87-72ea32bd3e15 at /dev/vdc
Apr 17 10:35:50 user nova-compute[82522]: DEBUG os_brick.utils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[400927f4-610e-4ea6-bd7c-870bae93027d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b779802-5d49-40c3-941b-c2855a024907]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0523cbee-77d1-437c-8f5f-91d98d76d835]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c9b31a-b3c6-4324-b65f-fd7ca70cea7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:50 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:35:50 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[96188581-7d49-40a4-8754-790bee2cf22a]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG os_brick.utils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:35:50 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating existing volume attachment record: dc2d59d7-9a90-4338-84ed-c3c7406f7421 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:35:51 user nova-compute[82522]: INFO nova.virt.block_device [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Booting with volume 8cf5c72f-e6de-4173-b335-076e979303d7 at /dev/vdc
Apr 17 10:35:51 user nova-compute[82522]: DEBUG os_brick.utils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0449c8bd-c74b-427a-ab38-764c907bf0f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41587c-dde3-4870-bb60-a26364219720]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea72b85-c0ae-4b39-9fab-7e5a93d206fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3675857c-aa1b-4df1-b05c-7eab52181dd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:35:52 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:35:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c06e7b-59ff-4bab-bae6-eded4649fd60]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG os_brick.utils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating existing volume attachment record: 4ec1bda2-10e3-4983-ae9b-e892fad71b65 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [{"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Releasing lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance network_info: |[{"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] Acquired lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:52 user nova-compute[82522]: DEBUG nova.network.neutron [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing network info cache for port 9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updated VIF entry in instance network info cache for port 9df6de54-e8fe-425b-a344-de73c3cc5d3e. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [{"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [{"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] Releasing lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] Acquired lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing network info cache for port 2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Releasing lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance network_info: |[{"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Acquired lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing network info cache for port d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updated VIF entry in instance network info cache for port 2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [{"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] Releasing lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updated VIF entry in instance network info cache for port d6c1ba60-17a7-41b4-85df-afed37da4170. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [{"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Releasing lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-changed-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing instance network info cache due to event network-changed-552d9aee-fdf7-4e99-8521-604486e3f888. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Acquiring lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Acquired lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing network info cache for port 552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updated VIF entry in instance network info cache for port 552d9aee-fdf7-4e99-8521-604486e3f888. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [{"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:35:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Releasing lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:35:55 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Creating image(s)
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Ensure instance console log exists: /opt/stack/data/nova/instances/1f120f04-ecbf-496e-81c9-dcfed9084064/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Start _get_guest_xml network_info=[{"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'f5d78f3b-26e1-4335-845d-4f398706ee30', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqaXNnjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f120f04-ecbf-496e-81c9-dcfed9084064', 'attached_at': '', 'detached_at': '', 'volume_id': '1b078c60-dd3a-40a5-b5cf-61f0546b7021', 'serial': '1b078c60-dd3a-40a5-b5cf-61f0546b7021'}, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'e3a87c8d-52c5-4c8b-bfe5-d4341b45bcc1', 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'covqTbmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f120f04-ecbf-496e-81c9-dcfed9084064', 'attached_at': '', 'detached_at': '', 'volume_id': '2e23bb78-786c-40bf-abd6-6ab77d4ed569', 'serial': '2e23bb78-786c-40bf-abd6-6ab77d4ed569'}, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'dc2d59d7-9a90-4338-84ed-c3c7406f7421', 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQRqkvlt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f120f04-ecbf-496e-81c9-dcfed9084064', 'attached_at': '', 'detached_at': '', 'volume_id': '7fb93d4e-544e-4909-9b87-72ea32bd3e15', 'serial': '7fb93d4e-544e-4909-9b87-72ea32bd3e15'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:35:55 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:55 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:35:55 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connector [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Factory for ISCSI on None {{(pid=82522) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.010s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqaXNnjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:56 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:35:56 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:35:56 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d7e7c-f8d4-40ef-b04e-ce35e1770d0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:35:56 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb4f218-64f0-4ceb-bf83-6b2b9ac0b105]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021] added
Apr 17 10:35:56 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee35aff6-3849-4245-9413-05d17e8d268d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f86dd27-fe7a-4ca8-9305-15d3129de979]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqaXNnjw {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqaXNnjw" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[96db07e1-d1f4-4c6e-81b3-feb5c884e5e5]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yqaXNnjw'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3ae6a8-6ebb-4635-b23d-46fb3b56e4ef]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f3e4d0-eaac-4cdf-ae9a-0dce6989e401]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 17 10:35:56 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 17 10:35:56 user nova-compute[82522]:  {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:35:56 user nova-compute[82522]: WARNING os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 17 10:35:56 user nova-compute[82522]: 
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[89af2ea7-0a53-407c-aff1-f160741f4987]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021, portal: 172.16.0.220,3260]
Apr 17 10:35:56 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021, portal: 172.16.0.220,3260] successful.
Apr 17 10:35:56 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b382b-627b-4268-98a7-7c329caba347]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a9305c-bfb6-4853-a0be-846c67138b12]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:56 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:56 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d53e666-6b9c-41c5-8958-a52e828f8f98]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqaXNnjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:35:56 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Creating image(s)
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Ensure instance console log exists: /opt/stack/data/nova/instances/250f2cd2-b6ba-4a89-921f-cbd21ac36525/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Start _get_guest_xml network_info=[{"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '1c2df823-84bc-400c-bc36-2b0261d669a7', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgncdmCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '250f2cd2-b6ba-4a89-921f-cbd21ac36525', 'attached_at': '', 'detached_at': '', 'volume_id': '9c283ca4-fc93-4f5f-ba1d-3190871dea02', 'serial': '9c283ca4-fc93-4f5f-ba1d-3190871dea02'}, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'ae9a5c04-4b2f-4878-897d-f9afb9f2e278', 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpKeSwsC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '250f2cd2-b6ba-4a89-921f-cbd21ac36525', 'attached_at': '', 'detached_at': '', 'volume_id': '46647c48-1076-472f-90b1-7e19985bfa7e', 'serial': '46647c48-1076-472f-90b1-7e19985bfa7e'}, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '4ec1bda2-10e3-4983-ae9b-e892fad71b65', 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqsLrwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '250f2cd2-b6ba-4a89-921f-cbd21ac36525', 'attached_at': '', 'detached_at': '', 'volume_id': '8cf5c72f-e6de-4173-b335-076e979303d7', 'serial': '8cf5c72f-e6de-4173-b335-076e979303d7'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:35:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgncdmCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:56 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:35:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26238386430313736', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238386430313736', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.345s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:35:57 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:35:57 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b317f8-7dad-4fb3-8018-6b992b601f36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:35:57 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'covqTbmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:57 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6dcea1-3908-47b1-a040-4f5c027a0064]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02] added
Apr 17 10:35:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0cd17-2066-4b66-97e1-8af52ee86478]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6140f4c3-0504-45c3-b78c-af131b7196ff]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgncdmCW {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgncdmCW" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc882d4-44e1-4f37-b0af-6fdcba751c23]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bgncdmCW'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1b455a-6b88-42c4-a37a-0b4431dbdb94]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[be958c97-02b5-4f5c-bbeb-68ab0ce2071c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a945b7bd-175a-49fc-90a0-1ba32b07aed2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02, portal: 172.16.0.220,3260]
Apr 17 10:35:57 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02, portal: 172.16.0.220,3260] successful.
Apr 17 10:35:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2af80b-675b-4239-b5fd-c6c78c268a53]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[314025a9-a929-45c5-8b74-82a3b1b04feb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:57 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:35:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:57 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:35:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7669aa6-3ecc-45ca-bd2e-f25d382440cd]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:35:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgncdmCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] <== connect_volume: return (1655ms) {'type': 'block', 'scsi_wwn': '26639633332626265', 'path': '/dev/sdc'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639633332626265', 'path': '/dev/sdc'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.278s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:35:58 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:35:58 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpKeSwsC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:58 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1ce350-4e40-4942-bee7-0d6795af398e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:35:58 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d7281d-d060-4a46-93e2-02b1315745f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569] added
Apr 17 10:35:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f970d04-05ee-4c84-9e83-17428d6b1f54]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61183c-bc0a-424f-8d1f-7afd75dafc04]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v covqTbmN {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v covqTbmN" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6f42c7-a338-41f2-9471-460df5084023]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'covqTbmN'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[486a2289-7df2-43a0-9ed8-b18836738623]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[216c1279-f00f-4b39-8c71-c797c692e0d0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe5a01-a192-4695-bb03-144d4fb85af7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569, portal: 172.16.0.220,3260]
Apr 17 10:35:58 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569, portal: 172.16.0.220,3260] successful.
Apr 17 10:35:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9369fc07-c21a-4b2e-869b-63ff2f559870]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b0b63e-c45a-4bd0-bc78-19635a384699]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:35:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af82b75-7f50-4722-999a-1bbe2ca73d3a]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:35:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'covqTbmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] <== connect_volume: return (2592ms) {'type': 'block', 'scsi_wwn': '23562333964386333', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562333964386333', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.288s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:35:59 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:35:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:35:59 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:35:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQRqkvlt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:35:59 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:35:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d460ddc7-86ef-43d4-a986-a69733fe0491]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:35:59 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:35:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c91b4d-5b08-45f8-8679-ed19adde0872]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e] added
Apr 17 10:36:00 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[803631ea-310f-4b93-af17-a9daf7be690f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ba24e8-bbd2-41ff-9cc6-cd57a1bbff7b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpKeSwsC {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpKeSwsC" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c84b202-c8a7-4359-9478-a9176ae9d88c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LpKeSwsC'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[19264532-8d8d-4e87-ba63-e5e83a10facf]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[017da7d7-41b1-4772-9efb-acadaadfd484]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e9f72d-8c54-45e3-bf9d-d92b68f10a87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e, portal: 172.16.0.220,3260]
Apr 17 10:36:00 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e, portal: 172.16.0.220,3260] successful.
Apr 17 10:36:00 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d5e057-8df8-459e-ae70-ee7da4e2a47e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2280d8-7c7e-4ffd-ab45-1cf1df69a84e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:00 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:00 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:00 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[486ea6dd-211b-40e5-b289-fc1641b4b46a]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:36:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpKeSwsC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] <== connect_volume: return (2627ms) {'type': 'block', 'scsi_wwn': '23963303638326162', 'path': '/dev/sde'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963303638326162', 'path': '/dev/sde'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.315s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:01 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqsLrwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc17cacd-375a-4ef7-812f-a63471a7023e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:36:01 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2726d73a-f7d8-4a0d-b393-e36e36be4299]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15] added
Apr 17 10:36:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e4455b-1bce-4d0a-b382-0b2513a02ac5]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe2b4f8-ff3e-474e-a826-a1302dfbff7e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQRqkvlt {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQRqkvlt" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f783bf87-de1d-4d92-93fe-d6a500777015]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iQRqkvlt'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116ff44-7207-429a-a7c9-ef23309523ec]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1404d8e1-25f8-45b8-9148-e487724e6cbe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d3660f-fa5d-4927-a4f8-49f5130d0557]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15, portal: 172.16.0.220,3260]
Apr 17 10:36:01 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15, portal: 172.16.0.220,3260] successful.
Apr 17 10:36:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[137d4890-8f51-48b4-8e79-f129a57bf669]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5251afb6-159c-49bc-a5cc-4682102bcc3c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:01 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bc44b6-494f-4862-a731-bc69351dd5cf]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQRqkvlt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] <== connect_volume: return (2662ms) {'type': 'block', 'scsi_wwn': '23935376539333031', 'path': '/dev/sdf'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935376539333031', 'path': '/dev/sdf'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.321s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:02 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:02 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5df728-a9b6-4d39-a623-4f18f03492b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:36:02 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:63:a8,bridge_name='br-int',has_traffic_filtering=True,id=acaf0b67-4938-4a01-ac74-86f0935046eb,network=Network(ab4771c2-e461-463d-9c08-c52f0fa689d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaf0b67-49') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:09,bridge_name='br-int',has_traffic_filtering=True,id=5ead9709-8869-4070-81f0-1e397c5ba789,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ead9709-88') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:bd,bridge_name='br-int',has_traffic_filtering=True,id=b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb2b605c5-b5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1e:c1,bridge_name='br-int',has_traffic_filtering=True,id=74fde78e-82b3-43f3-9c87-2b754a4bd66f,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fde78e-82') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a0:b7,bridge_name='br-int',has_traffic_filtering=True,id=b3872258-192d-4118-b77a-98dee0f21115,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3872258-19') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:97:d9,bridge_name='br-int',has_traffic_filtering=True,id=d6c1ba60-17a7-41b4-85df-afed37da4170,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c1ba60-17') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:4c:35,bridge_name='br-int',has_traffic_filtering=True,id=552d9aee-fdf7-4e99-8521-604486e3f888,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552d9aee-fd') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.objects.instance [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f120f04-ecbf-496e-81c9-dcfed9084064 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fcb4cc-a237-4495-b7ea-8ac5e88845e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7] added
Apr 17 10:36:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:36:02 user nova-compute[82522]:   <uuid>1f120f04-ecbf-496e-81c9-dcfed9084064</uuid>
Apr 17 10:36:02 user nova-compute[82522]:   <name>instance-0000000a</name>
Apr 17 10:36:02 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:36:02 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:36:02 user nova-compute[82522]:   <metadata>
Apr 17 10:36:02 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:36:02 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:36:02 user nova-compute[82522]:       <nova:name>tempest-device-tagging-server-238332109</nova:name>
Apr 17 10:36:02 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:35:55</nova:creationTime>
Apr 17 10:36:02 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:36:02 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:36:02 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:36:02 user nova-compute[82522]:       <nova:owner>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:user uuid="245581ebc4824aa7addd4d4272d4a47d">tempest-TaggedBootDevicesTest_v242-99130841-project-member</nova:user>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:project uuid="c5c3233510fa4ef1bb876bd6ee37a443">tempest-TaggedBootDevicesTest_v242-99130841</nova:project>
Apr 17 10:36:02 user nova-compute[82522]:       </nova:owner>
Apr 17 10:36:02 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:36:02 user nova-compute[82522]:       <nova:ports>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:port uuid="acaf0b67-4938-4a01-ac74-86f0935046eb">
Apr 17 10:36:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 10:36:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:port uuid="5ead9709-8869-4070-81f0-1e397c5ba789">
Apr 17 10:36:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Apr 17 10:36:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:port uuid="b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8">
Apr 17 10:36:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Apr 17 10:36:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:port uuid="74fde78e-82b3-43f3-9c87-2b754a4bd66f">
Apr 17 10:36:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.1.1.144" ipVersion="4"/>
Apr 17 10:36:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:port uuid="b3872258-192d-4118-b77a-98dee0f21115">
Apr 17 10:36:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.1.1.160" ipVersion="4"/>
Apr 17 10:36:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:port uuid="d6c1ba60-17a7-41b4-85df-afed37da4170">
Apr 17 10:36:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 17 10:36:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:02 user nova-compute[82522]:         <nova:port uuid="552d9aee-fdf7-4e99-8521-604486e3f888">
Apr 17 10:36:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 17 10:36:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:02 user nova-compute[82522]:       </nova:ports>
Apr 17 10:36:02 user nova-compute[82522]:     </nova:instance>
Apr 17 10:36:02 user nova-compute[82522]:   </metadata>
Apr 17 10:36:02 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:36:02 user nova-compute[82522]:     <system>
Apr 17 10:36:02 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:36:02 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:36:02 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:36:02 user nova-compute[82522]:       <entry name="serial">1f120f04-ecbf-496e-81c9-dcfed9084064</entry>
Apr 17 10:36:02 user nova-compute[82522]:       <entry name="uuid">1f120f04-ecbf-496e-81c9-dcfed9084064</entry>
Apr 17 10:36:02 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:36:02 user nova-compute[82522]:     </system>
Apr 17 10:36:02 user nova-compute[82522]:   </sysinfo>
Apr 17 10:36:02 user nova-compute[82522]:   <os>
Apr 17 10:36:02 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:36:02 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:36:02 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:36:02 user nova-compute[82522]:   </os>
Apr 17 10:36:02 user nova-compute[82522]:   <features>
Apr 17 10:36:02 user nova-compute[82522]:     <acpi/>
Apr 17 10:36:02 user nova-compute[82522]:     <apic/>
Apr 17 10:36:02 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:36:02 user nova-compute[82522]:   </features>
Apr 17 10:36:02 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:36:02 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:36:02 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:36:02 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:36:02 user nova-compute[82522]:   </clock>
Apr 17 10:36:02 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:36:02 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:36:02 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:36:02 user nova-compute[82522]:   </cpu>
Apr 17 10:36:02 user nova-compute[82522]:   <devices>
Apr 17 10:36:02 user nova-compute[82522]:     <disk type="file" device="cdrom">
Apr 17 10:36:02 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none"/>
Apr 17 10:36:02 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/1f120f04-ecbf-496e-81c9-dcfed9084064/disk.config"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="hda" bus="ide"/>
Apr 17 10:36:02 user nova-compute[82522]:     </disk>
Apr 17 10:36:02 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:36:02 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:36:02 user nova-compute[82522]:       <source dev="/dev/sdb"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <serial>1b078c60-dd3a-40a5-b5cf-61f0546b7021</serial>
Apr 17 10:36:02 user nova-compute[82522]:     </disk>
Apr 17 10:36:02 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:36:02 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:36:02 user nova-compute[82522]:       <source dev="/dev/sdd"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <serial>2e23bb78-786c-40bf-abd6-6ab77d4ed569</serial>
Apr 17 10:36:02 user nova-compute[82522]:     </disk>
Apr 17 10:36:02 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:36:02 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:36:02 user nova-compute[82522]:       <source dev="/dev/sdf"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="vdc" bus="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <serial>7fb93d4e-544e-4909-9b87-72ea32bd3e15</serial>
Apr 17 10:36:02 user nova-compute[82522]:     </disk>
Apr 17 10:36:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:02 user nova-compute[82522]:       <mac address="fa:16:3e:4a:63:a8"/>
Apr 17 10:36:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="tapacaf0b67-49"/>
Apr 17 10:36:02 user nova-compute[82522]:     </interface>
Apr 17 10:36:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:02 user nova-compute[82522]:       <mac address="fa:16:3e:d2:d6:09"/>
Apr 17 10:36:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="tap5ead9709-88"/>
Apr 17 10:36:02 user nova-compute[82522]:     </interface>
Apr 17 10:36:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:02 user nova-compute[82522]:       <mac address="fa:16:3e:bf:e6:bd"/>
Apr 17 10:36:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="tapb2b605c5-b5"/>
Apr 17 10:36:02 user nova-compute[82522]:     </interface>
Apr 17 10:36:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:02 user nova-compute[82522]:       <mac address="fa:16:3e:ba:1e:c1"/>
Apr 17 10:36:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="tap74fde78e-82"/>
Apr 17 10:36:02 user nova-compute[82522]:     </interface>
Apr 17 10:36:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:02 user nova-compute[82522]:       <mac address="fa:16:3e:63:a0:b7"/>
Apr 17 10:36:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="tapb3872258-19"/>
Apr 17 10:36:02 user nova-compute[82522]:     </interface>
Apr 17 10:36:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:02 user nova-compute[82522]:       <mac address="fa:16:3e:68:97:d9"/>
Apr 17 10:36:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="tapd6c1ba60-17"/>
Apr 17 10:36:02 user nova-compute[82522]:     </interface>
Apr 17 10:36:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:02 user nova-compute[82522]:       <mac address="fa:16:3e:70:4c:35"/>
Apr 17 10:36:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:02 user nova-compute[82522]:       <target dev="tap552d9aee-fd"/>
Apr 17 10:36:02 user nova-compute[82522]:     </interface>
Apr 17 10:36:02 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:36:02 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/1f120f04-ecbf-496e-81c9-dcfed9084064/console.log" append="off"/>
Apr 17 10:36:02 user nova-compute[82522]:     </serial>
Apr 17 10:36:02 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:36:02 user nova-compute[82522]:     <video>
Apr 17 10:36:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:02 user nova-compute[82522]:     </video>
Apr 17 10:36:02 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:36:02 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:36:02 user nova-compute[82522]:     </rng>
Apr 17 10:36:02 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:36:02 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:36:02 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:36:02 user nova-compute[82522]:     </memballoon>
Apr 17 10:36:02 user nova-compute[82522]:   </devices>
Apr 17 10:36:02 user nova-compute[82522]: </domain>
Apr 17 10:36:02 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:63:a8,bridge_name='br-int',has_traffic_filtering=True,id=acaf0b67-4938-4a01-ac74-86f0935046eb,network=Network(ab4771c2-e461-463d-9c08-c52f0fa689d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaf0b67-49') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:63:a8,bridge_name='br-int',has_traffic_filtering=True,id=acaf0b67-4938-4a01-ac74-86f0935046eb,network=Network(ab4771c2-e461-463d-9c08-c52f0fa689d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaf0b67-49') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacaf0b67-49, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapacaf0b67-49, col_values=(('external_ids', {'iface-id': 'acaf0b67-4938-4a01-ac74-86f0935046eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:63:a8', 'vm-uuid': '1f120f04-ecbf-496e-81c9-dcfed9084064'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: INFO os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:63:a8,bridge_name='br-int',has_traffic_filtering=True,id=acaf0b67-4938-4a01-ac74-86f0935046eb,network=Network(ab4771c2-e461-463d-9c08-c52f0fa689d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaf0b67-49')
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:09,bridge_name='br-int',has_traffic_filtering=True,id=5ead9709-8869-4070-81f0-1e397c5ba789,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ead9709-88') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:09,bridge_name='br-int',has_traffic_filtering=True,id=5ead9709-8869-4070-81f0-1e397c5ba789,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ead9709-88') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.052s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee46759-e209-4cfa-a36c-05682c78606b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ead9709-88, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ead9709-88, col_values=(('external_ids', {'iface-id': '5ead9709-8869-4070-81f0-1e397c5ba789', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:d6:09', 'vm-uuid': '1f120f04-ecbf-496e-81c9-dcfed9084064'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15f7854-90db-48f2-8bf1-5b466d173fd7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxqsLrwl {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: INFO os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:09,bridge_name='br-int',has_traffic_filtering=True,id=5ead9709-8869-4070-81f0-1e397c5ba789,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ead9709-88')
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:bd,bridge_name='br-int',has_traffic_filtering=True,id=b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb2b605c5-b5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:bd,bridge_name='br-int',has_traffic_filtering=True,id=b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb2b605c5-b5') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2b605c5-b5, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2b605c5-b5, col_values=(('external_ids', {'iface-id': 'b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:e6:bd', 'vm-uuid': '1f120f04-ecbf-496e-81c9-dcfed9084064'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxqsLrwl" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf7ec6a-9e41-466a-9c8e-e0ed4db2c21c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WxqsLrwl'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: INFO os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:bd,bridge_name='br-int',has_traffic_filtering=True,id=b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb2b605c5-b5')
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1e:c1,bridge_name='br-int',has_traffic_filtering=True,id=74fde78e-82b3-43f3-9c87-2b754a4bd66f,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fde78e-82') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1e:c1,bridge_name='br-int',has_traffic_filtering=True,id=74fde78e-82b3-43f3-9c87-2b754a4bd66f,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fde78e-82') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd644af-d6d8-42e7-b8f9-3a35ad57d0b5]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74fde78e-82, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74fde78e-82, col_values=(('external_ids', {'iface-id': '74fde78e-82b3-43f3-9c87-2b754a4bd66f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:1e:c1', 'vm-uuid': '1f120f04-ecbf-496e-81c9-dcfed9084064'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3407a20a-ad41-4b52-8f63-dcf8d2397da2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:02 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:02 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:02 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:02 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:02 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:02 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:02 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:02 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: INFO os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1e:c1,bridge_name='br-int',has_traffic_filtering=True,id=74fde78e-82b3-43f3-9c87-2b754a4bd66f,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fde78e-82')
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a0:b7,bridge_name='br-int',has_traffic_filtering=True,id=b3872258-192d-4118-b77a-98dee0f21115,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3872258-19') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a0:b7,bridge_name='br-int',has_traffic_filtering=True,id=b3872258-192d-4118-b77a-98dee0f21115,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3872258-19') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3872258-19, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3872258-19, col_values=(('external_ids', {'iface-id': 'b3872258-192d-4118-b77a-98dee0f21115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:a0:b7', 'vm-uuid': '1f120f04-ecbf-496e-81c9-dcfed9084064'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: INFO os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a0:b7,bridge_name='br-int',has_traffic_filtering=True,id=b3872258-192d-4118-b77a-98dee0f21115,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3872258-19')
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:97:d9,bridge_name='br-int',has_traffic_filtering=True,id=d6c1ba60-17a7-41b4-85df-afed37da4170,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c1ba60-17') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:97:d9,bridge_name='br-int',has_traffic_filtering=True,id=d6c1ba60-17a7-41b4-85df-afed37da4170,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c1ba60-17') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6c1ba60-17, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6c1ba60-17, col_values=(('external_ids', {'iface-id': 'd6c1ba60-17a7-41b4-85df-afed37da4170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:97:d9', 'vm-uuid': '1f120f04-ecbf-496e-81c9-dcfed9084064'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbfc24c-b9f2-4a26-9b52-aba3c4bb12de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7, portal: 172.16.0.220,3260]
Apr 17 10:36:02 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7, portal: 172.16.0.220,3260] successful.
Apr 17 10:36:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce07ccc-a296-4f39-815c-6b3eaf933013]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[711f61ba-274d-4456-8c85-9109d377692b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:03 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:03 user nova-compute[82522]: INFO os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:97:d9,bridge_name='br-int',has_traffic_filtering=True,id=d6c1ba60-17a7-41b4-85df-afed37da4170,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c1ba60-17')
Apr 17 10:36:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:4c:35,bridge_name='br-int',has_traffic_filtering=True,id=552d9aee-fdf7-4e99-8521-604486e3f888,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552d9aee-fd') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:4c:35,bridge_name='br-int',has_traffic_filtering=True,id=552d9aee-fdf7-4e99-8521-604486e3f888,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552d9aee-fd') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap552d9aee-fd, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap552d9aee-fd, col_values=(('external_ids', {'iface-id': '552d9aee-fdf7-4e99-8521-604486e3f888', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:4c:35', 'vm-uuid': '1f120f04-ecbf-496e-81c9-dcfed9084064'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d4720-0faa-4220-b353-fd67bfc6bc6a]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:03 user nova-compute[82522]: INFO os_vif [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:4c:35,bridge_name='br-int',has_traffic_filtering=True,id=552d9aee-fdf7-4e99-8521-604486e3f888,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552d9aee-fd')
Apr 17 10:36:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] No BDM found with device name hda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] No VIF found with MAC fa:16:3e:4a:63:a8, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] No VIF found with MAC fa:16:3e:63:a0:b7, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:36:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Using config drive
Apr 17 10:36:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Creating config drive at /opt/stack/data/nova/instances/1f120f04-ecbf-496e-81c9-dcfed9084064/disk.config
Apr 17 10:36:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1f120f04-ecbf-496e-81c9-dcfed9084064/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwmolphdm {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1f120f04-ecbf-496e-81c9-dcfed9084064/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwmolphdm" returned: 0 in 0.053s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqsLrwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] <== connect_volume: return (2707ms) {'type': 'block', 'scsi_wwn': '23534316438613166', 'path': '/dev/sdg'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534316438613166', 'path': '/dev/sdg'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=4ea57433-f4d1-4edf-ac36-c8099ce1cd8e,network=Network(6256e79c-cac6-4326-ab0a-322a4d5c61f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea57433-f4') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:70:9f,bridge_name='br-int',has_traffic_filtering=True,id=03ae70e4-ee40-4b09-a38b-a819ee74d880,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03ae70e4-ee') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:8b:69,bridge_name='br-int',has_traffic_filtering=True,id=77da47f6-f251-457d-b4c9-a2687922abc5,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77da47f6-f2') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f9:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ea3a20e-3d8d-4cab-9783-0a22cab2e27b,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3a20e-3d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:db:c5,bridge_name='br-int',has_traffic_filtering=True,id=c3988098-5dbd-47e1-896c-6a2b6415f64d,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3988098-5d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:f8:a9,bridge_name='br-int',has_traffic_filtering=True,id=2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aeeb2c5-6b') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:93:37,bridge_name='br-int',has_traffic_filtering=True,id=9df6de54-e8fe-425b-a344-de73c3cc5d3e,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df6de54-e8') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lazy-loading 'pci_devices' on Instance uuid 250f2cd2-b6ba-4a89-921f-cbd21ac36525 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:36:04 user nova-compute[82522]:   <uuid>250f2cd2-b6ba-4a89-921f-cbd21ac36525</uuid>
Apr 17 10:36:04 user nova-compute[82522]:   <name>instance-00000009</name>
Apr 17 10:36:04 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:36:04 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:36:04 user nova-compute[82522]:   <metadata>
Apr 17 10:36:04 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:36:04 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:36:04 user nova-compute[82522]:       <nova:name>tempest-device-tagging-server-154424156</nova:name>
Apr 17 10:36:04 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:35:56</nova:creationTime>
Apr 17 10:36:04 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:36:04 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:36:04 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:36:04 user nova-compute[82522]:       <nova:owner>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:user uuid="41eaa1a7dc224ec4bd8ebd5fdef1fbeb">tempest-TaggedBootDevicesTest-615877170-project-member</nova:user>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:project uuid="a553d324884a4e5785c896d76b2a9376">tempest-TaggedBootDevicesTest-615877170</nova:project>
Apr 17 10:36:04 user nova-compute[82522]:       </nova:owner>
Apr 17 10:36:04 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:36:04 user nova-compute[82522]:       <nova:ports>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:port uuid="4ea57433-f4d1-4edf-ac36-c8099ce1cd8e">
Apr 17 10:36:04 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 17 10:36:04 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:port uuid="03ae70e4-ee40-4b09-a38b-a819ee74d880">
Apr 17 10:36:04 user nova-compute[82522]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Apr 17 10:36:04 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:port uuid="77da47f6-f251-457d-b4c9-a2687922abc5">
Apr 17 10:36:04 user nova-compute[82522]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Apr 17 10:36:04 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:port uuid="0ea3a20e-3d8d-4cab-9783-0a22cab2e27b">
Apr 17 10:36:04 user nova-compute[82522]:           <nova:ip type="fixed" address="10.1.1.196" ipVersion="4"/>
Apr 17 10:36:04 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:port uuid="c3988098-5dbd-47e1-896c-6a2b6415f64d">
Apr 17 10:36:04 user nova-compute[82522]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Apr 17 10:36:04 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:port uuid="2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38">
Apr 17 10:36:04 user nova-compute[82522]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 17 10:36:04 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:04 user nova-compute[82522]:         <nova:port uuid="9df6de54-e8fe-425b-a344-de73c3cc5d3e">
Apr 17 10:36:04 user nova-compute[82522]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 17 10:36:04 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:04 user nova-compute[82522]:       </nova:ports>
Apr 17 10:36:04 user nova-compute[82522]:     </nova:instance>
Apr 17 10:36:04 user nova-compute[82522]:   </metadata>
Apr 17 10:36:04 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:36:04 user nova-compute[82522]:     <system>
Apr 17 10:36:04 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:36:04 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:36:04 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:36:04 user nova-compute[82522]:       <entry name="serial">250f2cd2-b6ba-4a89-921f-cbd21ac36525</entry>
Apr 17 10:36:04 user nova-compute[82522]:       <entry name="uuid">250f2cd2-b6ba-4a89-921f-cbd21ac36525</entry>
Apr 17 10:36:04 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:36:04 user nova-compute[82522]:     </system>
Apr 17 10:36:04 user nova-compute[82522]:   </sysinfo>
Apr 17 10:36:04 user nova-compute[82522]:   <os>
Apr 17 10:36:04 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:36:04 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:36:04 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:36:04 user nova-compute[82522]:   </os>
Apr 17 10:36:04 user nova-compute[82522]:   <features>
Apr 17 10:36:04 user nova-compute[82522]:     <acpi/>
Apr 17 10:36:04 user nova-compute[82522]:     <apic/>
Apr 17 10:36:04 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:36:04 user nova-compute[82522]:   </features>
Apr 17 10:36:04 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:36:04 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:36:04 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:36:04 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:36:04 user nova-compute[82522]:   </clock>
Apr 17 10:36:04 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:36:04 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:36:04 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:36:04 user nova-compute[82522]:   </cpu>
Apr 17 10:36:04 user nova-compute[82522]:   <devices>
Apr 17 10:36:04 user nova-compute[82522]:     <disk type="file" device="cdrom">
Apr 17 10:36:04 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none"/>
Apr 17 10:36:04 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/250f2cd2-b6ba-4a89-921f-cbd21ac36525/disk.config"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="hda" bus="ide"/>
Apr 17 10:36:04 user nova-compute[82522]:     </disk>
Apr 17 10:36:04 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:36:04 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:36:04 user nova-compute[82522]:       <source dev="/dev/sdc"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <serial>9c283ca4-fc93-4f5f-ba1d-3190871dea02</serial>
Apr 17 10:36:04 user nova-compute[82522]:     </disk>
Apr 17 10:36:04 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:36:04 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:36:04 user nova-compute[82522]:       <source dev="/dev/sde"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <serial>46647c48-1076-472f-90b1-7e19985bfa7e</serial>
Apr 17 10:36:04 user nova-compute[82522]:     </disk>
Apr 17 10:36:04 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:36:04 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:36:04 user nova-compute[82522]:       <source dev="/dev/sdg"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="vdc" bus="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <serial>8cf5c72f-e6de-4173-b335-076e979303d7</serial>
Apr 17 10:36:04 user nova-compute[82522]:     </disk>
Apr 17 10:36:04 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:04 user nova-compute[82522]:       <mac address="fa:16:3e:0b:2c:f8"/>
Apr 17 10:36:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="tap4ea57433-f4"/>
Apr 17 10:36:04 user nova-compute[82522]:     </interface>
Apr 17 10:36:04 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:04 user nova-compute[82522]:       <mac address="fa:16:3e:09:70:9f"/>
Apr 17 10:36:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="tap03ae70e4-ee"/>
Apr 17 10:36:04 user nova-compute[82522]:     </interface>
Apr 17 10:36:04 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:04 user nova-compute[82522]:       <mac address="fa:16:3e:da:8b:69"/>
Apr 17 10:36:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="tap77da47f6-f2"/>
Apr 17 10:36:04 user nova-compute[82522]:     </interface>
Apr 17 10:36:04 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:04 user nova-compute[82522]:       <mac address="fa:16:3e:bb:f9:d7"/>
Apr 17 10:36:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="tap0ea3a20e-3d"/>
Apr 17 10:36:04 user nova-compute[82522]:     </interface>
Apr 17 10:36:04 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:04 user nova-compute[82522]:       <mac address="fa:16:3e:7e:db:c5"/>
Apr 17 10:36:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="tapc3988098-5d"/>
Apr 17 10:36:04 user nova-compute[82522]:     </interface>
Apr 17 10:36:04 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:04 user nova-compute[82522]:       <mac address="fa:16:3e:70:f8:a9"/>
Apr 17 10:36:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="tap2aeeb2c5-6b"/>
Apr 17 10:36:04 user nova-compute[82522]:     </interface>
Apr 17 10:36:04 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:04 user nova-compute[82522]:       <mac address="fa:16:3e:77:93:37"/>
Apr 17 10:36:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:04 user nova-compute[82522]:       <target dev="tap9df6de54-e8"/>
Apr 17 10:36:04 user nova-compute[82522]:     </interface>
Apr 17 10:36:04 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:36:04 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/250f2cd2-b6ba-4a89-921f-cbd21ac36525/console.log" append="off"/>
Apr 17 10:36:04 user nova-compute[82522]:     </serial>
Apr 17 10:36:04 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:36:04 user nova-compute[82522]:     <video>
Apr 17 10:36:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:04 user nova-compute[82522]:     </video>
Apr 17 10:36:04 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:36:04 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:36:04 user nova-compute[82522]:     </rng>
Apr 17 10:36:04 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:36:04 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:36:04 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:36:04 user nova-compute[82522]:     </memballoon>
Apr 17 10:36:04 user nova-compute[82522]:   </devices>
Apr 17 10:36:04 user nova-compute[82522]: </domain>
Apr 17 10:36:04 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=4ea57433-f4d1-4edf-ac36-c8099ce1cd8e,network=Network(6256e79c-cac6-4326-ab0a-322a4d5c61f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea57433-f4') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=4ea57433-f4d1-4edf-ac36-c8099ce1cd8e,network=Network(6256e79c-cac6-4326-ab0a-322a4d5c61f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea57433-f4') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ea57433-f4, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ea57433-f4, col_values=(('external_ids', {'iface-id': '4ea57433-f4d1-4edf-ac36-c8099ce1cd8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:2c:f8', 'vm-uuid': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: INFO os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=4ea57433-f4d1-4edf-ac36-c8099ce1cd8e,network=Network(6256e79c-cac6-4326-ab0a-322a4d5c61f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea57433-f4')
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:70:9f,bridge_name='br-int',has_traffic_filtering=True,id=03ae70e4-ee40-4b09-a38b-a819ee74d880,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03ae70e4-ee') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:70:9f,bridge_name='br-int',has_traffic_filtering=True,id=03ae70e4-ee40-4b09-a38b-a819ee74d880,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03ae70e4-ee') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03ae70e4-ee, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03ae70e4-ee, col_values=(('external_ids', {'iface-id': '03ae70e4-ee40-4b09-a38b-a819ee74d880', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:70:9f', 'vm-uuid': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: INFO os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:70:9f,bridge_name='br-int',has_traffic_filtering=True,id=03ae70e4-ee40-4b09-a38b-a819ee74d880,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03ae70e4-ee')
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:8b:69,bridge_name='br-int',has_traffic_filtering=True,id=77da47f6-f251-457d-b4c9-a2687922abc5,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77da47f6-f2') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8b:69,bridge_name='br-int',has_traffic_filtering=True,id=77da47f6-f251-457d-b4c9-a2687922abc5,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77da47f6-f2') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77da47f6-f2, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77da47f6-f2, col_values=(('external_ids', {'iface-id': '77da47f6-f251-457d-b4c9-a2687922abc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:8b:69', 'vm-uuid': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: INFO os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8b:69,bridge_name='br-int',has_traffic_filtering=True,id=77da47f6-f251-457d-b4c9-a2687922abc5,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77da47f6-f2')
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f9:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ea3a20e-3d8d-4cab-9783-0a22cab2e27b,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3a20e-3d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f9:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ea3a20e-3d8d-4cab-9783-0a22cab2e27b,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3a20e-3d') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ea3a20e-3d, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ea3a20e-3d, col_values=(('external_ids', {'iface-id': '0ea3a20e-3d8d-4cab-9783-0a22cab2e27b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:f9:d7', 'vm-uuid': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: INFO os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f9:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ea3a20e-3d8d-4cab-9783-0a22cab2e27b,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3a20e-3d')
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:db:c5,bridge_name='br-int',has_traffic_filtering=True,id=c3988098-5dbd-47e1-896c-6a2b6415f64d,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3988098-5d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:db:c5,bridge_name='br-int',has_traffic_filtering=True,id=c3988098-5dbd-47e1-896c-6a2b6415f64d,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3988098-5d') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3988098-5d, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3988098-5d, col_values=(('external_ids', {'iface-id': 'c3988098-5dbd-47e1-896c-6a2b6415f64d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:db:c5', 'vm-uuid': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: INFO os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:db:c5,bridge_name='br-int',has_traffic_filtering=True,id=c3988098-5dbd-47e1-896c-6a2b6415f64d,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3988098-5d')
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:f8:a9,bridge_name='br-int',has_traffic_filtering=True,id=2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aeeb2c5-6b') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:f8:a9,bridge_name='br-int',has_traffic_filtering=True,id=2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aeeb2c5-6b') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2aeeb2c5-6b, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2aeeb2c5-6b, col_values=(('external_ids', {'iface-id': '2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:f8:a9', 'vm-uuid': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: INFO os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:f8:a9,bridge_name='br-int',has_traffic_filtering=True,id=2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aeeb2c5-6b')
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:93:37,bridge_name='br-int',has_traffic_filtering=True,id=9df6de54-e8fe-425b-a344-de73c3cc5d3e,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df6de54-e8') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:93:37,bridge_name='br-int',has_traffic_filtering=True,id=9df6de54-e8fe-425b-a344-de73c3cc5d3e,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df6de54-e8') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9df6de54-e8, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9df6de54-e8, col_values=(('external_ids', {'iface-id': '9df6de54-e8fe-425b-a344-de73c3cc5d3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:93:37', 'vm-uuid': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:05 user nova-compute[82522]: WARNING nova.compute.manager [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-acaf0b67-4938-4a01-ac74-86f0935046eb for instance with vm_state building and task_state spawning.
Apr 17 10:36:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:05 user nova-compute[82522]: INFO os_vif [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:93:37,bridge_name='br-int',has_traffic_filtering=True,id=9df6de54-e8fe-425b-a344-de73c3cc5d3e,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df6de54-e8')
Apr 17 10:36:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] No BDM found with device name hda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] No VIF found with MAC fa:16:3e:0b:2c:f8, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] No VIF found with MAC fa:16:3e:7e:db:c5, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:36:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Using config drive
Apr 17 10:36:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Creating config drive at /opt/stack/data/nova/instances/250f2cd2-b6ba-4a89-921f-cbd21ac36525/disk.config
Apr 17 10:36:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/250f2cd2-b6ba-4a89-921f-cbd21ac36525/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo2wjm922 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/250f2cd2-b6ba-4a89-921f-cbd21ac36525/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo2wjm922" returned: 0 in 0.054s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:05 user nova-compute[82522]: WARNING nova.compute.manager [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-5ead9709-8869-4070-81f0-1e397c5ba789 for instance with vm_state building and task_state spawning.
Apr 17 10:36:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-acaf0b67-4938-4a01-ac74-86f0935046eb for instance with vm_state building and task_state spawning.
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 for instance with vm_state building and task_state spawning.
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 for instance with vm_state building and task_state spawning.
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance with vm_state building and task_state spawning.
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance with vm_state building and task_state spawning.
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-b3872258-192d-4118-b77a-98dee0f21115 for instance with vm_state building and task_state spawning.
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-b3872258-192d-4118-b77a-98dee0f21115 for instance with vm_state building and task_state spawning.
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-d6c1ba60-17a7-41b4-85df-afed37da4170 for instance with vm_state building and task_state spawning.
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-552d9aee-fdf7-4e99-8521-604486e3f888 for instance with vm_state building and task_state spawning.
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:07 user nova-compute[82522]: WARNING nova.compute.manager [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-5ead9709-8869-4070-81f0-1e397c5ba789 for instance with vm_state building and task_state spawning.
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:09 user nova-compute[82522]: WARNING nova.compute.manager [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-d6c1ba60-17a7-41b4-85df-afed37da4170 for instance with vm_state building and task_state spawning.
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:09 user nova-compute[82522]: WARNING nova.compute.manager [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 for instance with vm_state building and task_state spawning.
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:09 user nova-compute[82522]: WARNING nova.compute.manager [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-552d9aee-fdf7-4e99-8521-604486e3f888 for instance with vm_state building and task_state spawning.
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:09 user nova-compute[82522]: WARNING nova.compute.manager [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance with vm_state building and task_state spawning.
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:09 user nova-compute[82522]: WARNING nova.compute.manager [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance with vm_state building and task_state spawning.
Apr 17 10:36:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727770.5491261, 1f120f04-ecbf-496e-81c9-dcfed9084064 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:36:10 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] VM Resumed (Lifecycle Event)
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:36:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance spawned successfully.
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:10 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727770.5584726, 1f120f04-ecbf-496e-81c9-dcfed9084064 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:36:10 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] VM Started (Lifecycle Event)
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:36:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:10 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:36:10 user nova-compute[82522]: INFO nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Took 14.77 seconds to spawn the instance on the hypervisor.
Apr 17 10:36:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:10 user nova-compute[82522]: INFO nova.compute.manager [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Took 33.45 seconds to build instance.
Apr 17 10:36:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.566s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-c3988098-5dbd-47e1-896c-6a2b6415f64d for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-c3988098-5dbd-47e1-896c-6a2b6415f64d for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-77da47f6-f251-457d-b4c9-a2687922abc5 for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-77da47f6-f251-457d-b4c9-a2687922abc5 for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance with vm_state building and task_state spawning.
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:11 user nova-compute[82522]: WARNING nova.compute.manager [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance with vm_state building and task_state spawning.
Apr 17 10:36:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727772.6896708, 250f2cd2-b6ba-4a89-921f-cbd21ac36525 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:36:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] VM Resumed (Lifecycle Event)
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:36:12 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance spawned successfully.
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727772.6930256, 250f2cd2-b6ba-4a89-921f-cbd21ac36525 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:36:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] VM Started (Lifecycle Event)
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:36:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:36:12 user nova-compute[82522]: INFO nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Took 15.89 seconds to spawn the instance on the hypervisor.
Apr 17 10:36:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:12 user nova-compute[82522]: INFO nova.compute.manager [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Took 36.34 seconds to build instance.
Apr 17 10:36:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.459s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:14 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:14 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:36:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-6cc638ee-d494-4523-8d12-9ede0853ecd6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:36:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-6cc638ee-d494-4523-8d12-9ede0853ecd6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:36:14 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:36:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:15 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Updating instance_info_cache with network_info: [{"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-6cc638ee-d494-4523-8d12-9ede0853ecd6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:36:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:36:15 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:15 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:19 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:36:19 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=7682MB free_disk=26.73247528076172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 59fd26de-d46e-4f41-91f6-090005a07d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 7792cf72-dc73-4201-9501-4515ce860735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:36:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:20 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:36:20 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:36:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:36:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:21 user nova-compute[82522]: INFO nova.compute.manager [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] instance snapshotting
Apr 17 10:36:21 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:36:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:36:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Beginning live snapshot process
Apr 17 10:36:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json -f qcow2 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json -f qcow2 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr3j5cjd6/d8b79550c2254e5390f2cfd64b2ac261.delta 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr3j5cjd6/d8b79550c2254e5390f2cfd64b2ac261.delta 1073741824" returned: 0 in 0.047s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 17 10:36:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Checking UEFI support for host arch (x86_64) {{(pid=82522) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 17 10:36:21 user nova-compute[82522]: INFO nova.virt.libvirt.host [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] UEFI support detected
Apr 17 10:36:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:36:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:36:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 17 10:36:23 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:36:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr3j5cjd6/d8b79550c2254e5390f2cfd64b2ac261.delta /opt/stack/data/nova/instances/snapshots/tmpr3j5cjd6/d8b79550c2254e5390f2cfd64b2ac261 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr3j5cjd6/d8b79550c2254e5390f2cfd64b2ac261.delta /opt/stack/data/nova/instances/snapshots/tmpr3j5cjd6/d8b79550c2254e5390f2cfd64b2ac261" returned: 0 in 0.194s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:23 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Snapshot extracted, beginning image upload
Apr 17 10:36:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:24 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:36:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:24 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:36:24 user nova-compute[82522]: INFO nova.compute.claims [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Claim successful on node user
Apr 17 10:36:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:25 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:36:25 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:36:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:36:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:36:25 user nova-compute[82522]: DEBUG nova.network.neutron [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:36:25 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:36:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:36:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:25 user nova-compute[82522]: DEBUG nova.objects.instance [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lazy-loading 'flavor' on Instance uuid 6cc638ee-d494-4523-8d12-9ede0853ecd6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:26 user nova-compute[82522]: INFO nova.virt.block_device [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Booting with volume 32955c44-ba4e-4422-bebe-32b68bb7b970 at /dev/vda
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.utils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c023b1-4df0-4b7d-87be-8792ea41a40c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1c0517-bf08-494f-b8dd-09b020111660]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Snapshot image upload complete
Apr 17 10:36:26 user nova-compute[82522]: INFO nova.compute.manager [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Took 5.13 seconds to snapshot the instance on the hypervisor.
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a25f6db-3aab-42cd-b0c6-919105c9664c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c396446-9a5d-4ecb-b7d5-8975478883ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:26 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e2ec21-f881-4812-b10d-67a5fef5805b]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.utils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating existing volume attachment record: 3d9e7531-d380-4fa6-b552-2575c016004a {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:26 user nova-compute[82522]: INFO nova.compute.manager [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Attaching volume 507c10d6-f250-402f-b7e4-2bf36b541aa4 to /dev/vdb
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.utils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d94f03f-6823-4447-be96-422833d22903]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG nova.policy [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b43c0aee7b05459d898e0dc2654262fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a793afb3e7045898c59a77975079d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bbc82e-eb82-48d8-8366-4db991bdf5b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff43a96f-e9c5-47f6-bd89-ef77b655bcc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ba2130-a615-48d6-8d97-2d4445d7c50e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:26 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:36:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a7c7c-2c0b-4f8e-8a87-75fa94ce5da0]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG os_brick.utils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:26 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Updating existing volume attachment record: b80a218f-0bc6-439d-b4bd-cf37d9729708 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:36:27 user nova-compute[82522]: DEBUG nova.network.neutron [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Successfully created port: 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Successfully updated port: 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquired lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing instance network info cache due to event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] Acquiring lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Releasing lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Instance network_info: |[{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] Acquired lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:36:28 user nova-compute[82522]: DEBUG nova.network.neutron [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:36:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updated VIF entry in instance network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:36:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] Releasing lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:36:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-changed-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Refreshing instance network info cache due to event network-changed-7124043d-665c-4a42-a041-b91ccc237b63. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:36:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] Acquiring lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:36:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] Acquired lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:36:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Refreshing network info cache for port 7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:36:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updated VIF entry in instance network info cache for port 7124043d-665c-4a42-a041-b91ccc237b63. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:36:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updating instance_info_cache with network_info: [{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] Releasing lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-changed-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Refreshing instance network info cache due to event network-changed-cd279a0c-99eb-4e32-876e-6d2208cc1db2. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] Acquiring lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] Acquired lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG nova.network.neutron [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Refreshing network info cache for port cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG nova.network.neutron [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updated VIF entry in instance network info cache for port cd279a0c-99eb-4e32-876e-6d2208cc1db2. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG nova.network.neutron [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updating instance_info_cache with network_info: [{"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] Releasing lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:33 user nova-compute[82522]: INFO nova.compute.manager [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Attaching volume 77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 to /dev/vdb
Apr 17 10:36:33 user nova-compute[82522]: DEBUG os_brick.utils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2cf858-044b-4947-8f31-104740dd23fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[87746502-96de-4c61-aecf-b937daf531d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd84f4ae-9554-4822-b11c-51392d9fb608]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b135d6-781e-4663-b8a0-ae47287e158e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:33 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40e1311-6b5d-4e89-8a27-e8ed407e4310]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG os_brick.utils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updating existing volume attachment record: 8b9fd253-6e8c-4a2f-8b96-20096969af9e {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:36:33 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Creating image(s)
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Ensure instance console log exists: /opt/stack/data/nova/instances/b0c707ac-b08f-4f18-8262-e1b79d7e17e1/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Start _get_guest_xml network_info=[{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '3d9e7531-d380-4fa6-b552-2575c016004a', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amnpFeIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0c707ac-b08f-4f18-8262-e1b79d7e17e1', 'attached_at': '', 'detached_at': '', 'volume_id': '32955c44-ba4e-4422-bebe-32b68bb7b970', 'serial': '32955c44-ba4e-4422-bebe-32b68bb7b970'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:36:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:36:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:36:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amnpFeIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:34 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:34 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:34 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44b4c8e-76fd-4ddb-ba80-8dcb5f1fce95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:36:34 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc574a-6746-4223-a631-93f3387f4446]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970] added
Apr 17 10:36:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c679928c-9ec3-4e19-a41f-edd7d811e197]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbad62d-ae1b-449b-a85f-64dcb798aeee]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amnpFeIh {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amnpFeIh" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[522a9d23-39cc-4809-b1d7-a4533c0345e7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'amnpFeIh'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a4fe5c-f32f-48f4-b1a8-608de28a6314]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c740cc9-2229-4cdb-ba15-1382326a7284]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a491d2b-780a-42a5-92df-ee022cccb3f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260]
Apr 17 10:36:34 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260] successful.
Apr 17 10:36:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea89a192-fb41-4941-a621-5adfee3abdfe]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82205b7-5175-41c4-bf5c-69fcfb78dea9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[99306132-dcfe-4cf2-bc74-01bb70560f7f]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amnpFeIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:36:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23531646630656239', 'path': '/dev/sdh'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531646630656239', 'path': '/dev/sdh'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-906009009',display_name='tempest-TestShelveInstance-server-906009009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-906009009',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH4FFXKqH+g7k0ASGnNDXfUy/R1u6icWp+zf9vlgtMbomh5J54TN/pK57/PFpeGZBHXgpMBfbuezVh6SWpKdljIUuRGib6lK5tHsF/MEgxDHkpa84AcMmldHwjGud+ZtQ==',key_name='tempest-TestShelveInstance-993329906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a793afb3e7045898c59a77975079d72',ramdisk_id='',reservation_id='r-g168xrnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2028370832',owner_user_name='tempest-TestShelveInstance-2028370832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:36:26Z,user_data=None,user_id='b43c0aee7b05459d898e0dc2654262fa',uuid=b0c707ac-b08f-4f18-8262-e1b79d7e17e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converting VIF {"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lazy-loading 'pci_devices' on Instance uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMwoXAaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:35 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:35 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:35 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:36:35 user nova-compute[82522]:   <uuid>b0c707ac-b08f-4f18-8262-e1b79d7e17e1</uuid>
Apr 17 10:36:35 user nova-compute[82522]:   <name>instance-0000000b</name>
Apr 17 10:36:35 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:36:35 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:36:35 user nova-compute[82522]:   <metadata>
Apr 17 10:36:35 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:36:35 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:36:35 user nova-compute[82522]:       <nova:name>tempest-TestShelveInstance-server-906009009</nova:name>
Apr 17 10:36:35 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:36:33</nova:creationTime>
Apr 17 10:36:35 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:36:35 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:36:35 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:36:35 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:36:35 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:36:35 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:36:35 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:36:35 user nova-compute[82522]:       <nova:owner>
Apr 17 10:36:35 user nova-compute[82522]:         <nova:user uuid="b43c0aee7b05459d898e0dc2654262fa">tempest-TestShelveInstance-2028370832-project-member</nova:user>
Apr 17 10:36:35 user nova-compute[82522]:         <nova:project uuid="5a793afb3e7045898c59a77975079d72">tempest-TestShelveInstance-2028370832</nova:project>
Apr 17 10:36:35 user nova-compute[82522]:       </nova:owner>
Apr 17 10:36:35 user nova-compute[82522]:       <nova:ports>
Apr 17 10:36:35 user nova-compute[82522]:         <nova:port uuid="90c85bb7-50e1-4c86-9c1f-e27f14fb50d3">
Apr 17 10:36:35 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 10:36:35 user nova-compute[82522]:         </nova:port>
Apr 17 10:36:35 user nova-compute[82522]:       </nova:ports>
Apr 17 10:36:35 user nova-compute[82522]:     </nova:instance>
Apr 17 10:36:35 user nova-compute[82522]:   </metadata>
Apr 17 10:36:35 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:36:35 user nova-compute[82522]:     <system>
Apr 17 10:36:35 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:36:35 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:36:35 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:36:35 user nova-compute[82522]:       <entry name="serial">b0c707ac-b08f-4f18-8262-e1b79d7e17e1</entry>
Apr 17 10:36:35 user nova-compute[82522]:       <entry name="uuid">b0c707ac-b08f-4f18-8262-e1b79d7e17e1</entry>
Apr 17 10:36:35 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:36:35 user nova-compute[82522]:     </system>
Apr 17 10:36:35 user nova-compute[82522]:   </sysinfo>
Apr 17 10:36:35 user nova-compute[82522]:   <os>
Apr 17 10:36:35 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:36:35 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:36:35 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:36:35 user nova-compute[82522]:   </os>
Apr 17 10:36:35 user nova-compute[82522]:   <features>
Apr 17 10:36:35 user nova-compute[82522]:     <acpi/>
Apr 17 10:36:35 user nova-compute[82522]:     <apic/>
Apr 17 10:36:35 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:36:35 user nova-compute[82522]:   </features>
Apr 17 10:36:35 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:36:35 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:36:35 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:36:35 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:36:35 user nova-compute[82522]:   </clock>
Apr 17 10:36:35 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:36:35 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:36:35 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:36:35 user nova-compute[82522]:   </cpu>
Apr 17 10:36:35 user nova-compute[82522]:   <devices>
Apr 17 10:36:35 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:36:35 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:36:35 user nova-compute[82522]:       <source dev="/dev/sdh"/>
Apr 17 10:36:35 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:36:35 user nova-compute[82522]:       <serial>32955c44-ba4e-4422-bebe-32b68bb7b970</serial>
Apr 17 10:36:35 user nova-compute[82522]:     </disk>
Apr 17 10:36:35 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:36:35 user nova-compute[82522]:       <mac address="fa:16:3e:c4:70:05"/>
Apr 17 10:36:35 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:35 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:36:35 user nova-compute[82522]:       <target dev="tap90c85bb7-50"/>
Apr 17 10:36:35 user nova-compute[82522]:     </interface>
Apr 17 10:36:35 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:36:35 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/b0c707ac-b08f-4f18-8262-e1b79d7e17e1/console.log" append="off"/>
Apr 17 10:36:35 user nova-compute[82522]:     </serial>
Apr 17 10:36:35 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:36:35 user nova-compute[82522]:     <video>
Apr 17 10:36:35 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:36:35 user nova-compute[82522]:     </video>
Apr 17 10:36:35 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:36:35 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:36:35 user nova-compute[82522]:     </rng>
Apr 17 10:36:35 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:36:35 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:36:35 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:36:35 user nova-compute[82522]:     </memballoon>
Apr 17 10:36:35 user nova-compute[82522]:   </devices>
Apr 17 10:36:35 user nova-compute[82522]: </domain>
Apr 17 10:36:35 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-906009009',display_name='tempest-TestShelveInstance-server-906009009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-906009009',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH4FFXKqH+g7k0ASGnNDXfUy/R1u6icWp+zf9vlgtMbomh5J54TN/pK57/PFpeGZBHXgpMBfbuezVh6SWpKdljIUuRGib6lK5tHsF/MEgxDHkpa84AcMmldHwjGud+ZtQ==',key_name='tempest-TestShelveInstance-993329906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a793afb3e7045898c59a77975079d72',ramdisk_id='',reservation_id='r-g168xrnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2028370832',owner_user_name='tempest-TestShelveInstance-2028370832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:36:26Z,user_data=None,user_id='b43c0aee7b05459d898e0dc2654262fa',uuid=b0c707ac-b08f-4f18-8262-e1b79d7e17e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converting VIF {"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_vif [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90c85bb7-50, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90c85bb7-50, col_values=(('external_ids', {'iface-id': '90c85bb7-50e1-4c86-9c1f-e27f14fb50d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:70:05', 'vm-uuid': 'b0c707ac-b08f-4f18-8262-e1b79d7e17e1'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb7ac3-91f0-412c-a390-61e500ddef41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:36:35 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:35 user nova-compute[82522]: INFO os_vif [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50')
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ea5767-7936-40e4-b30d-45ad4efc4466]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4] added
Apr 17 10:36:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa25af-d017-46b3-b1ab-6543a40c2d35]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] No VIF found with MAC fa:16:3e:c4:70:05, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37ccbc-47a0-4d87-b303-06835ad97c3b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eMwoXAaJ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eMwoXAaJ" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b211634-9850-489d-8a9f-b61f5bc4093f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eMwoXAaJ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8364b2f-7562-47e8-bb48-f070115432fb]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0203c085-754f-409f-a717-365470390d39]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebe94f4-9f8c-41ee-8cae-be696c55d242]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4, portal: 172.16.0.220,3260]
Apr 17 10:36:35 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4, portal: 172.16.0.220,3260] successful.
Apr 17 10:36:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2d9cf0-d01f-450f-bef2-32a65720d589]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:35 user nova-compute[82522]: INFO nova.compute.manager [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Shelving
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8688662d-29ed-42c2-8fd6-bf6444ca4fb4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)
Apr 17 10:36:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe44ce5-4118-4005-a18b-be4bcdbbfd16]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMwoXAaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-unplugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] No waiting events found dispatching network-vif-unplugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:36 user nova-compute[82522]: WARNING nova.compute.manager [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received unexpected event network-vif-unplugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance with vm_state active and task_state shelving.
Apr 17 10:36:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-changed-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Refreshing instance network info cache due to event network-changed-f839dea5-4294-4842-bfa2-262351dabfb9. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] Acquiring lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] Acquired lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG nova.network.neutron [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Refreshing network info cache for port f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26432626464346362', 'path': '/dev/sdi'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432626464346362', 'path': '/dev/sdi'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG nova.objects.instance [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lazy-loading 'flavor' on Instance uuid 6cc638ee-d494-4523-8d12-9ede0853ecd6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:36:36 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:36:36 user nova-compute[82522]:   <source dev="/dev/sdi"/>
Apr 17 10:36:36 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:36:36 user nova-compute[82522]:   <serial>507c10d6-f250-402f-b7e4-2bf36b541aa4</serial>
Apr 17 10:36:36 user nova-compute[82522]: </disk>
Apr 17 10:36:36 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updated VIF entry in instance network info cache for port f839dea5-4294-4842-bfa2-262351dabfb9. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] Releasing lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] No VIF found with MAC fa:16:3e:6c:5d:f5, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.468s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:37 user nova-compute[82522]: INFO nova.compute.manager [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] instance snapshotting
Apr 17 10:36:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:37 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance destroyed successfully.
Apr 17 10:36:37 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Beginning live snapshot process
Apr 17 10:36:37 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Beginning cold snapshot process
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json -f qcow2 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk /opt/stack/data/nova/instances/snapshots/tmpq2mly1mn/9520c8680b0949bb9ffe82bb87fc1e82 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json -f qcow2 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] No waiting events found dispatching network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:38 user nova-compute[82522]: WARNING nova.compute.manager [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received unexpected event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance with vm_state active and task_state shelving_image_pending_upload.
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXJauTtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:38 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:38 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:38 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[917c674d-b85d-4447-be44-6492f54b06a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:36:38 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjq1m0_j0/2556d9eb851c43fb9aedcbbbf2392b36.delta 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecd0b70-d957-43c5-8760-13ae5e2e094c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1] added
Apr 17 10:36:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[46889a19-cb59-48f2-8702-3de493a664f1]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjq1m0_j0/2556d9eb851c43fb9aedcbbbf2392b36.delta 1073741824" returned: 0 in 0.095s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c719322-c40d-451d-8e6a-1342c01a8b1d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXJauTtP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXJauTtP" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[524df6e6-b00d-474c-9666-a78c4d45226f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VXJauTtP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[62499e14-ba2c-44f7-a605-86636549422f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] No waiting events found dispatching network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:38 user nova-compute[82522]: WARNING nova.compute.manager [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received unexpected event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance with vm_state building and task_state spawning.
Apr 17 10:36:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] No waiting events found dispatching network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:38 user nova-compute[82522]: WARNING nova.compute.manager [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received unexpected event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance with vm_state building and task_state spawning.
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7454dcba-1347-4ae2-913e-eea966b5f814]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:38 user nova-compute[82522]: INFO nova.compute.manager [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Terminating instance
Apr 17 10:36:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[50db80f9-b37f-4fe8-8144-c3011c29ba63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260]
Apr 17 10:36:38 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260] successful.
Apr 17 10:36:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk /opt/stack/data/nova/instances/snapshots/tmpq2mly1mn/9520c8680b0949bb9ffe82bb87fc1e82" returned: 0 in 0.711s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Snapshot extracted, beginning image upload
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb47a35-e8ca-4e60-b409-986f2b759817]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[202c7289-7532-4ee9-bfb9-a2ce95c9c9b9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)
Apr 17 10:36:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e52907-ac59-44dc-8d46-600284c4a5d2]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXJauTtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:36:39 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Instance destroyed successfully.
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.objects.instance [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lazy-loading 'resources' on Instance uuid 6cc638ee-d494-4523-8d12-9ede0853ecd6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2104151254',display_name='tempest-DeleteServersTestJSON-server-2104151254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2104151254',id=2,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02daa1fd267646fbb4f726b247ba4a6b',ramdisk_id='',reservation_id='r-n5a5xrbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1683071550',owner_user_name='tempest-DeleteServersTestJSON-1683071550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:34:46Z,user_data=None,user_id='7f4863ef9d61412a997abf4f27cce1b7',uuid=6cc638ee-d494-4523-8d12-9ede0853ecd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Converting VIF {"id": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "address": "fa:16:3e:6c:5d:f5", "network": {"id": "7923a088-f9c0-4c11-9907-e94389c269f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-199410990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02daa1fd267646fbb4f726b247ba4a6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ac6671-38", "ovs_interfaceid": "d6ac6671-38e6-49a1-ba35-e903ffc15afa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:5d:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6ac6671-38e6-49a1-ba35-e903ffc15afa,network=Network(7923a088-f9c0-4c11-9907-e94389c269f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ac6671-38') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_vif [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:5d:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6ac6671-38e6-49a1-ba35-e903ffc15afa,network=Network(7923a088-f9c0-4c11-9907-e94389c269f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ac6671-38') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6ac6671-38, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:39 user nova-compute[82522]: INFO os_vif [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:5d:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6ac6671-38e6-49a1-ba35-e903ffc15afa,network=Network(7923a088-f9c0-4c11-9907-e94389c269f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ac6671-38')
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMwoXAaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:39 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:36:39 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23366396637366437', 'path': '/dev/sdj'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366396637366437', 'path': '/dev/sdj'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.193s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47e5ec3-f892-4912-b6ed-50f0bf1c67e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:36:39 user nova-compute[82522]: No targets found.
Apr 17 10:36:39 user nova-compute[82522]: iSNS:
Apr 17 10:36:39 user nova-compute[82522]: No targets found.
Apr 17 10:36:39 user nova-compute[82522]: STATIC:
Apr 17 10:36:39 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:36:39 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:36:39 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:36:39 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e
Apr 17 10:36:39 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:36:39 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:36:39 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02
Apr 17 10:36:39 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:36:39 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:36:39 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:36:39 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:36:39 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:36:39 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021
Apr 17 10:36:39 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:36:39 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:36:39 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:36:39 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:36:39 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:36:39 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4
Apr 17 10:36:39 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:36:39 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:36:39 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:36:39 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:36:39 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:36:39 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7
Apr 17 10:36:39 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:36:39 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:36:39 user nova-compute[82522]: FIRMWARE:
Apr 17 10:36:39 user nova-compute[82522]: No targets found.
Apr 17 10:36:39 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:36:39 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:36:39 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6c1cb3-cf87-46a6-a67f-ac2d6b70e5d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjq1m0_j0/2556d9eb851c43fb9aedcbbbf2392b36.delta /opt/stack/data/nova/instances/snapshots/tmpjq1m0_j0/2556d9eb851c43fb9aedcbbbf2392b36 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b091ab4b-a6f7-4139-a635-c9e5c5262ba7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 (non-flash)
Apr 17 10:36:39 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28442c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4'): ({'sdi'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Removing single pathed devices sdi {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:36:40 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:36:40 user nova-compute[82522]:   <source dev="/dev/sdj"/>
Apr 17 10:36:40 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:36:40 user nova-compute[82522]:   <serial>77166f39-c9b1-499f-9ed8-1fdd6a0d81a1</serial>
Apr 17 10:36:40 user nova-compute[82522]: </disk>
Apr 17 10:36:40 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc57f927-4279-4301-a1fa-5dd88c3adc33]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ab8a22-e1ed-4eb0-8a4e-6ee69f918a43]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Flushing IO for device /dev/sdi {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727800.076925, b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] VM Resumed (Lifecycle Event)
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af22083-04d2-40a6-8b8a-ba3c1a2e6ba2]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Instance spawned successfully.
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.060s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a9c28a-ec0e-4bf3-9474-033ee0b33fab]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] SCSI volumes sdi have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727800.0786133, b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] VM Started (Lifecycle Event)
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjq1m0_j0/2556d9eb851c43fb9aedcbbbf2392b36.delta /opt/stack/data/nova/instances/snapshots/tmpjq1m0_j0/2556d9eb851c43fb9aedcbbbf2392b36" returned: 0 in 0.240s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Snapshot extracted, beginning image upload
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2684ca22-f7a3-46fe-8713-8a9e7e19c2a2]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Took 6.30 seconds to spawn the instance on the hypervisor.
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb10357c-96e5-4348-ad48-d6822da0809a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4, portal: 172.16.0.220,3260]
Apr 17 10:36:40 user nova-compute[82522]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4, portal: 172.16.0.220,3260] successful.
Apr 17 10:36:40 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received event network-vif-unplugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Acquiring lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] No waiting events found dispatching network-vif-unplugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received event network-vif-unplugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received event network-vif-plugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Acquiring lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] No waiting events found dispatching network-vif-plugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:40 user nova-compute[82522]: WARNING nova.compute.manager [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received unexpected event network-vif-plugged-d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance with vm_state active and task_state deleting.
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507c10d6-f250-402f-b7e4-2bf36b541aa4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c113a28-7fa9-4aa2-88f2-e13e6467f318]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] <== disconnect_volume: return (640ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Deleting instance files /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6_del
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Deletion of /opt/stack/data/nova/instances/6cc638ee-d494-4523-8d12-9ede0853ecd6_del complete
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.compute.manager [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Took 15.59 seconds to build instance.
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.711s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:40 user nova-compute[82522]: INFO nova.compute.manager [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Took 1.69 seconds to destroy the instance on the hypervisor.
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No VIF found with MAC fa:16:3e:7f:75:70, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.460s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82522) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG nova.objects.instance [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:41 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Took 0.86 seconds to deallocate network for instance.
Apr 17 10:36:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Snapshot image upload complete
Apr 17 10:36:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:41 user nova-compute[82522]: INFO nova.compute.manager [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Shelve offloading
Apr 17 10:36:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance destroyed successfully.
Apr 17 10:36:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquired lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:36:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance destroyed successfully.
Apr 17 10:36:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.914s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updating instance_info_cache with network_info: [{"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:42 user nova-compute[82522]: INFO nova.compute.manager [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Took 0.91 seconds to detach 1 volumes for instance.
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Releasing lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Received event network-vif-deleted-d6ac6671-38e6-49a1-ba35-e903ffc15afa {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-unplugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-unplugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:42 user nova-compute[82522]: WARNING nova.compute.manager [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-unplugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state stopped and task_state None.
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:36:42 user nova-compute[82522]: WARNING nova.compute.manager [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state stopped and task_state None.
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Snapshot image upload complete
Apr 17 10:36:42 user nova-compute[82522]: INFO nova.compute.manager [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Took 4.93 seconds to snapshot the instance on the hypervisor.
Apr 17 10:36:42 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Deleted allocations for instance 6cc638ee-d494-4523-8d12-9ede0853ecd6
Apr 17 10:36:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "6cc638ee-d494-4523-8d12-9ede0853ecd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.087s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance destroyed successfully.
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.objects.instance [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'resources' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-146173286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-146173286',id=4,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnvtiDTDPjiz0hQ6df6omtPSqLx8cphP5uhCzg3kQ4E0fo/fGmWEtXCk0ZdSSLB3uDiMb6lTel263kG9OXq4VKHzNS8Ca9hU4viwWvpL2VficVcm9xF14aNByKdknbl9g==',key_name='tempest-keypair-850060525',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-llggnnwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member',shelved_at='2023-04-17T10:36:41.562825',shelved_host='user',shelved_image_id='41ee7e1e-9d03-4b1f-8337-75bdcd458d85'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=c4315753-415c-45cd-b06f-da1e3ccc6e4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG os_vif [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd279a0c-99, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:36:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:42 user nova-compute[82522]: INFO os_vif [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99')
Apr 17 10:36:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Deleting instance files /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d_del
Apr 17 10:36:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Deletion of /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d_del complete
Apr 17 10:36:43 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Deleted allocations for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d
Apr 17 10:36:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:43 user nova-compute[82522]: DEBUG nova.objects.instance [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'numa_topology' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:43 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:36:43 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:36:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.736s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:52 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681727797.8024263, c4315753-415c-45cd-b06f-da1e3ccc6e4d => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:36:52 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] VM Stopped (Lifecycle Event)
Apr 17 10:36:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9406eb49-50bf-498b-b4d3-07cce42831c9 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received event network-changed-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Refreshing instance network info cache due to event network-changed-01527ff5-7a84-4bbf-ae89-ef334a97fc0a. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] Acquiring lock "refresh_cache-3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] Acquired lock "refresh_cache-3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Refreshing network info cache for port 01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG nova.objects.instance [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lazy-loading 'flavor' on Instance uuid 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:54 user nova-compute[82522]: INFO nova.compute.manager [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Attaching volume c9c51694-0e80-4e17-8d79-5c0c1563a356 to /dev/vdb
Apr 17 10:36:54 user nova-compute[82522]: DEBUG os_brick.utils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f242de1-93ac-4ecf-ac4f-b81f73e30f3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d918b3-ca13-4fe2-8e88-d0c439613d6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0054a3-2dba-4d33-92ff-8420274a15ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc66421-c921-47f3-8ca7-2bad8146cc3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:54 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca0497c-a3d1-4d00-aa0c-f31efc9f182e]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG os_brick.utils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Updating existing volume attachment record: 36aad1d5-7932-43b0-b6d1-bbda20ce3761 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Updated VIF entry in instance network info cache for port 01527ff5-7a84-4bbf-ae89-ef334a97fc0a. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Updating instance_info_cache with network_info: [{"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681727799.6317213, 6cc638ee-d494-4523-8d12-9ede0853ecd6 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:36:54 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] VM Stopped (Lifecycle Event)
Apr 17 10:36:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] Releasing lock "refresh_cache-3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:36:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a16e5bbc-abe3-47b2-a6af-1c5ea54d1889 None None] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received event network-changed-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Refreshing instance network info cache due to event network-changed-6289bf49-e33d-4ce9-bac7-376417d7abb8. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] Acquiring lock "refresh_cache-5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] Acquired lock "refresh_cache-5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Refreshing network info cache for port 6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Updated VIF entry in instance network info cache for port 6289bf49-e33d-4ce9-bac7-376417d7abb8. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Updating instance_info_cache with network_info: [{"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] Releasing lock "refresh_cache-5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681727801.8205814, 59fd26de-d46e-4f41-91f6-090005a07d99 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:36:56 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] VM Stopped (Lifecycle Event)
Apr 17 10:36:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c83d3bb2-bc56-44ce-a77b-36aee6c58ef0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:36:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c83d3bb2-bc56-44ce-a77b-36aee6c58ef0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:36:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG nova.objects.instance [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lazy-loading 'flavor' on Instance uuid 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:36:58 user nova-compute[82522]: INFO nova.compute.manager [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Attaching volume 510fd9d0-e377-4ace-8f40-485a192ec2d6 to /dev/sdc
Apr 17 10:36:58 user nova-compute[82522]: DEBUG os_brick.utils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce4cf75-e74c-40f6-a6d4-2b2fc1483293]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ba91df-df6c-42a6-8ac3-4235267c3f39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb6a2de-49b8-4c49-aead-e1f89047dffe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[686ebe4b-4643-4151-8f82-e7385788b6f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:36:58 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:36:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00130c8-46e9-4b54-81d2-4ed19a1a7f7e]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG os_brick.utils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Updating existing volume attachment record: 728398e4-c41c-4324-8d8d-a8be420fb9cf {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:36:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUBVRNbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:36:59 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:59 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:36:59 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[84787835-0d10-4133-b7a1-854d4dccecc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:36:59 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a7a43-3497-4273-afc7-6a027e7c97cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356] added
Apr 17 10:36:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8181935f-f382-4160-804d-50468747bb31]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8693978f-8fb8-4ec3-a3e0-3c9bc20feaf2]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUBVRNbG {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUBVRNbG" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[81acaf96-0b95-4175-ad9a-cfb601d19b5c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lUBVRNbG'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c41a9c-e88d-467e-bf0e-4a2cf1d019d4]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1836b54e-e023-4753-a713-1d9171a2d2b8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[423184eb-6ac5-42b0-b5ae-ef4330954f60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260]
Apr 17 10:36:59 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260] successful.
Apr 17 10:36:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b424178-fbed-472d-80a6-dbfbf647479f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667ac98-a8b0-4c49-8a21-447cb7af6dd9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:36:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee094b-6a28-47e9-85e7-4b4694727144]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:36:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUBVRNbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:37:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23061613835363432', 'path': '/dev/sdi'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061613835363432', 'path': '/dev/sdi'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:37:00 user nova-compute[82522]: DEBUG nova.objects.instance [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lazy-loading 'flavor' on Instance uuid 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:37:00 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:37:00 user nova-compute[82522]:   <source dev="/dev/sdi"/>
Apr 17 10:37:00 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:37:00 user nova-compute[82522]:   <serial>c9c51694-0e80-4e17-8d79-5c0c1563a356</serial>
Apr 17 10:37:00 user nova-compute[82522]: </disk>
Apr 17 10:37:00 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:37:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:37:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:37:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] No VIF found with MAC fa:16:3e:f5:52:19, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:37:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.970s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG os_brick.utils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6990547f-a95a-41a1-8af8-c4530f5261e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513c972-e913-49bc-bc60-77d6aff28dbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ee8645-638f-4497-9dc5-ad3352dd11af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[83781138-670a-46a6-9acc-0a777238847f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:37:02 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:37:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef0446f-b2c4-46ed-9e38-359e733c875f]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:37:02 user nova-compute[82522]: DEBUG os_brick.utils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:02 user nova-compute[82522]: INFO nova.compute.manager [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Swapping volume c9c51694-0e80-4e17-8d79-5c0c1563a356 for 15d9e421-b60b-4e95-8794-1b0ee1777ae2
Apr 17 10:37:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTWgJcMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:03 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:03 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:03 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b61bdda-a9f2-4b68-8fc0-6c7135bba73d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:37:03 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4447a3a-74a1-40f1-a7ca-e2cd36c01c64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6] added
Apr 17 10:37:03 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7d7a57-eca5-4dd3-aaf7-147977fbe501]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e932c8-5024-499f-ac02-75205f564991]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oTWgJcMQ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oTWgJcMQ" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0a5cbc-468a-4bec-bedb-fbb5da63373b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oTWgJcMQ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd272a5e-f225-4576-88a7-75ae67b00cf5]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[170c42a2-1801-475e-a745-e0c4a6cafa1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6d3851-76ad-4e0a-b9a5-21386190b8e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6, portal: 172.16.0.220,3260]
Apr 17 10:37:03 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:03 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10b7946-2f80-4193-a65f-3d0c15ffee6c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b5a0fe-3e76-48db-be78-e8e2245dce5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:03 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e2b4a3-81be-40b3-b5f1-dfda99766bbd]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTWgJcMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:37:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23433373565623261', 'path': '/dev/sdk'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433373565623261', 'path': '/dev/sdk'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:37:04 user nova-compute[82522]: DEBUG nova.objects.instance [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lazy-loading 'flavor' on Instance uuid 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:37:04 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:37:04 user nova-compute[82522]:   <source dev="/dev/sdk"/>
Apr 17 10:37:04 user nova-compute[82522]:   <target dev="sdc" bus="scsi"/>
Apr 17 10:37:04 user nova-compute[82522]:   <serial>510fd9d0-e377-4ace-8f40-485a192ec2d6</serial>
Apr 17 10:37:04 user nova-compute[82522]:   <address type="drive" controller="0" unit="2"/>
Apr 17 10:37:04 user nova-compute[82522]: </disk>
Apr 17 10:37:04 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:37:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] No BDM found with device name sda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:37:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:37:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] No BDM found with device name sdc, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:37:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] No VIF found with MAC fa:16:3e:b1:ee:b8, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:37:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.803s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:06 user nova-compute[82522]: INFO nova.compute.manager [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Detaching volume 510fd9d0-e377-4ace-8f40-485a192ec2d6
Apr 17 10:37:06 user nova-compute[82522]: INFO nova.virt.block_device [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Attempting to driver detach volume 510fd9d0-e377-4ace-8f40-485a192ec2d6 from mountpoint /dev/sdc
Apr 17 10:37:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Attempting to detach device sdc from instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:37:06 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:37:06 user nova-compute[82522]:   <source dev="/dev/sdk"/>
Apr 17 10:37:06 user nova-compute[82522]:   <target dev="sdc" bus="scsi"/>
Apr 17 10:37:06 user nova-compute[82522]:   <serial>510fd9d0-e377-4ace-8f40-485a192ec2d6</serial>
Apr 17 10:37:06 user nova-compute[82522]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 17 10:37:06 user nova-compute[82522]: </disk>
Apr 17 10:37:06 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:37:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Successfully detached device sdc from instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab from the persistent domain config.
Apr 17 10:37:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:37:06 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:37:06 user nova-compute[82522]:   <source dev="/dev/sdk"/>
Apr 17 10:37:06 user nova-compute[82522]:   <target dev="sdc" bus="scsi"/>
Apr 17 10:37:06 user nova-compute[82522]:   <serial>510fd9d0-e377-4ace-8f40-485a192ec2d6</serial>
Apr 17 10:37:06 user nova-compute[82522]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 17 10:37:06 user nova-compute[82522]: </disk>
Apr 17 10:37:06 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681727826.7101612, 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:37:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Successfully detached device sdc from instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab from the live domain config.
Apr 17 10:37:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTWgJcMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:06 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9c0e6d-d7a6-4e1a-b809-e81681fc1b61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:06 user nova-compute[82522]: No targets found.
Apr 17 10:37:06 user nova-compute[82522]: iSNS:
Apr 17 10:37:06 user nova-compute[82522]: No targets found.
Apr 17 10:37:06 user nova-compute[82522]: STATIC:
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7
Apr 17 10:37:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:06 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:06 user nova-compute[82522]: No targets found.
Apr 17 10:37:06 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:06 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:06 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d83fd89-c871-43e8-84fc-5f76e5189e9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[90643f7b-650b-4153-9575-2a3e137bc277]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:06 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7cdaa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6'): ({'sdk'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Removing single pathed devices sdk {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ccabd6-cb1f-411c-aa4d-51bc9df82512]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[31012c49-7af2-452f-a137-697eec1dbc5a]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Flushing IO for device /dev/sdk {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc0aa6b-6b3e-4744-87f9-025aa134c772]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.041s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7492823f-6637-4a3f-ad10-40c974bc48f5]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] SCSI volumes sdk have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87b6847-4a40-4153-bc89-eada65af7e03]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3bc382-24b7-4d8e-8005-c2a8feaa540a]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6, portal: 172.16.0.220,3260]
Apr 17 10:37:07 user nova-compute[82522]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510fd9d0-e377-4ace-8f40-485a192ec2d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0e3e72-74a6-432c-89fb-14d1b83b3134]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] <== disconnect_volume: return (354ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG nova.compute.manager [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLbjMCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d', 'attached_at': '', 'detached_at': '', 'volume_id': '15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'serial': '15d9e421-b60b-4e95-8794-1b0ee1777ae2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUBVRNbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c51694-0e80-4e17-8d79-5c0c1563a356', 'serial'} {{(pid=82522) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLbjMCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:07 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:07 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:07 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b82b11a-1420-4d6f-a809-347f2b766fe9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:37:07 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4803ae3f-42d9-4e2e-904c-2f09b370ea4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2] added
Apr 17 10:37:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d39e83-9b52-480b-b5c1-b23bc6257a4f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade22366-42ae-4113-843a-c5894ae588e7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NLbjMCzc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NLbjMCzc" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9201bf46-1250-4d5b-8e0e-0eb62e551cc3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NLbjMCzc'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c9536f-2014-4486-9ae8-09f347eb9ca0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c583649a-6858-47f8-9f52-7ec7d807854e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac626e2-325f-423c-85c0-13b7b0bc2674]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2, portal: 172.16.0.220,3260]
Apr 17 10:37:07 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[32801ab6-38e4-4d14-b65b-20ca25bf9a35]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dddd49-8041-41f1-af53-c5ff84ac3ced]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e6ab69-e3b8-47bb-b5c9-d1277f056c5c]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:37:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG nova.objects.instance [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lazy-loading 'flavor' on Instance uuid 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.874s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLbjMCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23663346534626564', 'path': '/dev/sdk'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663346534626564', 'path': '/dev/sdk'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG nova.objects.instance [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lazy-loading 'flavor' on Instance uuid 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:08 user nova-compute[82522]: INFO nova.compute.manager [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Terminating instance
Apr 17 10:37:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received event network-vif-unplugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] No waiting events found dispatching network-vif-unplugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received event network-vif-unplugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Instance destroyed successfully.
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.objects.instance [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lazy-loading 'resources' on Instance uuid 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-341764488',display_name='tempest-AttachSCSIVolumeTestJSON-server-341764488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-341764488',id=7,image_ref='ba2509ee-798b-4a36-b711-51a9b4dc7e2c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqZ/L6Z2Kpu64fEasPk05MYgGtpWeDJ254P2nPv61ccoonFszcT+uOvzrkLkO3pDSfAypS69UN5RLH0LaeaUpvK1JdPPzFtcQDbiz2XV5NbfAUmtLuHYK+SIu/wbWz9zw==',key_name='tempest-keypair-2120973316',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50344f2e70ef48de8fbf64d408e61210',ramdisk_id='',reservation_id='r-arqfenpq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ba2509ee-798b-4a36-b711-51a9b4dc7e2c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1369167370',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1369167370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a9df3167c7947aab20f7c2ef837fe92',uuid=5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Converting VIF {"id": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "address": "fa:16:3e:b1:ee:b8", "network": {"id": "c223b63d-e8a2-4312-ab68-1bec24248b1d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-599189402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50344f2e70ef48de8fbf64d408e61210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6289bf49-e3", "ovs_interfaceid": "6289bf49-e33d-4ce9-bac7-376417d7abb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=6289bf49-e33d-4ce9-bac7-376417d7abb8,network=Network(c223b63d-e8a2-4312-ab68-1bec24248b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6289bf49-e3') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG os_vif [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=6289bf49-e33d-4ce9-bac7-376417d7abb8,network=Network(c223b63d-e8a2-4312-ab68-1bec24248b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6289bf49-e3') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6289bf49-e3, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:09 user nova-compute[82522]: INFO os_vif [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=6289bf49-e33d-4ce9-bac7-376417d7abb8,network=Network(c223b63d-e8a2-4312-ab68-1bec24248b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6289bf49-e3')
Apr 17 10:37:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Deleting instance files /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab_del
Apr 17 10:37:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Deletion of /opt/stack/data/nova/instances/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab_del complete
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 171966464 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:09 user nova-compute[82522]: INFO nova.compute.manager [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 17 10:37:09 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:37:09 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:37:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 358612992 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 548405248 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received event network-vif-plugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] Acquiring lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] No waiting events found dispatching network-vif-plugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:11 user nova-compute[82522]: WARNING nova.compute.manager [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received unexpected event network-vif-plugged-6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance with vm_state active and task_state deleting.
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 723517440 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:11 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Took 1.63 seconds to deallocate network for instance.
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Received event network-vif-deleted-6289bf49-e33d-4ce9-bac7-376417d7abb8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:11 user nova-compute[82522]: INFO nova.compute.manager [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Neutron deleted interface 6289bf49-e33d-4ce9-bac7-376417d7abb8; detaching it from the instance and deleting it from the info cache
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.network.neutron [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Detach interface failed, port_id=6289bf49-e33d-4ce9-bac7-376417d7abb8, reason: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 849346560 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:37:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:11 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Deleted allocations for instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab
Apr 17 10:37:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.285s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 1019215872 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUBVRNbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:12 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feeb69c-d164-4021-8cad-1bea7ee86369]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:12 user nova-compute[82522]: No targets found.
Apr 17 10:37:12 user nova-compute[82522]: iSNS:
Apr 17 10:37:12 user nova-compute[82522]: No targets found.
Apr 17 10:37:12 user nova-compute[82522]: STATIC:
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7
Apr 17 10:37:12 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:12 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:12 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:12 user nova-compute[82522]: No targets found.
Apr 17 10:37:12 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:12 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:12 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed35547-2dd9-4891-8f7f-33c06eb0d3b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc420a8b-fa22-4559-93fb-02ee0597bd79]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:12 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2ac11ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356'): ({'sdi'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Removing single pathed devices sdi {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[053cc7a6-4720-40ef-9592-f85108b6d514]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd25ade7-3ce9-494a-877a-785ecdc0631b]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Flushing IO for device /dev/sdi {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c9f74a-c329-4f83-ad91-da04a768d1dc]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[133de6f4-98d9-4a03-bddb-fa56e8e34d46]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] SCSI volumes sdi have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7d3a28-ce44-4fb2-a738-d0624fad5b94]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4023a1-8ad9-4b7d-b01a-b3c4b6e64088]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260]
Apr 17 10:37:13 user nova-compute[82522]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1925152b-ea01-4edc-8a67-81669440ff48]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] <== disconnect_volume: return (380ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG nova.compute.manager [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLbjMCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d', 'attached_at': '', 'detached_at': '', 'volume_id': '15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'serial'} {{(pid=82522) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG nova.compute.manager [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] swap_volume: removing Cinder connection for volume c9c51694-0e80-4e17-8d79-5c0c1563a356 {{(pid=82522) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 17 10:37:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG nova.compute.manager [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] swap_volume: Updating volume c9c51694-0e80-4e17-8d79-5c0c1563a356 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NLbjMCzc", "auth_password": "P7N9joD8E2Q0Wy", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "15d9e421-b60b-4e95-8794-1b0ee1777ae2"}, "status": "reserved", "instance": "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d", "attached_at": "", "detached_at": "", "volume_id": "15d9e421-b60b-4e95-8794-1b0ee1777ae2", "serial": "15d9e421-b60b-4e95-8794-1b0ee1777ae2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'no_device': None, 'attachment_id': '290d3cee-521b-49b9-8725-967a92d8e8a7'} {{(pid=82522) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.712s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG os_brick.utils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b8469b-9b0a-4bf4-bcbe-9e01c6c14b2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca31916-c39d-4a51-9264-0a522f196b75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d79ad8-9e0a-4288-8323-cf7df3b0161b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe0bbfb-5fbb-4ac2-90ac-8f7b197002b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:37:14 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:37:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26ed98c-a484-4d54-89fd-330ed4da14af]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:37:14 user nova-compute[82522]: DEBUG os_brick.utils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:14 user nova-compute[82522]: INFO nova.compute.manager [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Swapping volume 15d9e421-b60b-4e95-8794-1b0ee1777ae2 for c9c51694-0e80-4e17-8d79-5c0c1563a356
Apr 17 10:37:15 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:37:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:37:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:37:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:37:15 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:37:15 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updating instance_info_cache with network_info: [{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:37:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:37:15 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:37:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:37:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:37:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUBVRNbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c51694-0e80-4e17-8d79-5c0c1563a356', 'serial': 'c9c51694-0e80-4e17-8d79-5c0c1563a356'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLbjMCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '15d9e421-b60b-4e95-8794-1b0ee1777ae2'}, 'status': 'reserved', 'instance': '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d', 'attached_at': '', 'detached_at': '', 'volume_id': '15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'serial'} {{(pid=82522) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUBVRNbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:19 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:19 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:19 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae6652a-1167-4e4e-90a6-a4b38888bf30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:37:19 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.compute.manager [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-changed-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.compute.manager [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Refreshing instance network info cache due to event network-changed-7d50333e-fed3-47d0-9aaf-bd1ab7238d62. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] Acquiring lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] Acquired lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG nova.network.neutron [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Refreshing network info cache for port 7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[90062595-8d07-4f03-8de7-793c1fe34f2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356] added
Apr 17 10:37:19 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a5e0f0-eb12-410d-8ccb-1533c602bbef]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1eba0e-1a97-4a7c-84ea-789ac15dd84f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUBVRNbG {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUBVRNbG" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[62899e47-1847-4bc0-a70e-585252c7db37]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lUBVRNbG'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:37:20 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=7892MB free_disk=26.655242919921875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf31948-1076-4730-a79a-b316266aeaa3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.objects.instance [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5183dd4f-9fa1-4d9e-90e9-d5f95451e99a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 59fd26de-d46e-4f41-91f6-090005a07d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 7792cf72-dc73-4201-9501-4515ce860735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[625d7f17-9102-42f1-9291-71b1bc17aff9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260]
Apr 17 10:37:20 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e94a7bf-e3e7-40d9-9da0-c33000945382]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0d82ac-f972-479d-9ffd-6d0501622b83]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.824s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:20 user nova-compute[82522]: INFO nova.compute.manager [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attaching volume 9cb32346-a238-439d-8ae8-b87c782d41d4 to /dev/vdb
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e8fad2-3059-40a3-80b2-974751982a48]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUBVRNbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.utils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bfc5b5-49f6-40ee-9fc8-c6dbf6769e36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[789cb854-e25e-4b23-aca1-a522a97dc9ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b2a30-2003-454f-b02b-d43289e892b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[db816cb3-d410-487b-a1c2-30bf1d4c298a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:37:20 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.network.neutron [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updated VIF entry in instance network info cache for port 7d50333e-fed3-47d0-9aaf-bd1ab7238d62. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.network.neutron [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating instance_info_cache with network_info: [{"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dc3780-6e47-4176-ba1a-4a3be42f75b2]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG os_brick.utils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating existing volume attachment record: 0c27dddd-e1a6-4bf9-a5ad-5b8725576955 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:37:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] Releasing lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:37:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.864s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] <== connect_volume: return (1866ms) {'type': 'block', 'scsi_wwn': '23061613835363432', 'path': '/dev/sdi'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061613835363432', 'path': '/dev/sdi'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:37:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lazy-loading 'flavor' on Instance uuid 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 174063616 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 360710144 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 505413632 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 674234368 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:24 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681727829.5571358, 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:37:24 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] VM Stopped (Lifecycle Event)
Apr 17 10:37:24 user nova-compute[82522]: DEBUG nova.compute.manager [None req-db56653c-2857-4878-b2f0-5f14af0f7108 None None] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:37:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 808452096 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 867172352 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 1046478848 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLbjMCzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '15d9e421-b60b-4e95-8794-1b0ee1777ae2': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:26 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe5d712-994b-4752-8384-da339afe45ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:26 user nova-compute[82522]: No targets found.
Apr 17 10:37:26 user nova-compute[82522]: iSNS:
Apr 17 10:37:26 user nova-compute[82522]: No targets found.
Apr 17 10:37:26 user nova-compute[82522]: STATIC:
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7
Apr 17 10:37:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:26 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:26 user nova-compute[82522]: No targets found.
Apr 17 10:37:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:26 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:26 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaeKnyDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:26 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bb76cb-049b-437e-ae5e-f17822b3043c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b369cb-2009-4d91-9c00-f046eb5b8586]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2846130a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2'): ({'sdk'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Removing single pathed devices sdk {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dbd99d-870c-42cc-84c4-5d8c39449404]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c015ebda-e17b-4526-857e-4f3f3dbcf37c]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Flushing IO for device /dev/sdk {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa3d35e-b1b5-467b-aaab-5ea2eba10185]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a13a3ef-cf23-4f9f-8009-a43ea7a2390b]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] SCSI volumes sdk have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c62b6-161d-4802-8780-e9a7989bea63]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f6e00e-76b2-4083-a01e-3a93c7ac4a6b]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2, portal: 172.16.0.220,3260]
Apr 17 10:37:26 user nova-compute[82522]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d9e421-b60b-4e95-8794-1b0ee1777ae2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe1098-b614-45f9-9ab5-67a589d5ddea]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] <== disconnect_volume: return (335ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.298s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:26 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:26 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa70cc97-94bd-4b6d-9341-11788f9df8ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:37:26 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c960f594-2b26-4a5d-98e1-a9259c67ffb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4] added
Apr 17 10:37:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUBVRNbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c51694-0e80-4e17-8d79-5c0c1563a356', 'serial'} {{(pid=82522) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] swap_volume: removing Cinder connection for volume 15d9e421-b60b-4e95-8794-1b0ee1777ae2 {{(pid=82522) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a2b6f-c29b-4b09-bb8b-90a30bb94028]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9527f7f4-dde3-4e2a-8298-a9fa26d2b855]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VaeKnyDk {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VaeKnyDk" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7789be-e0db-42ea-a430-36d3a54d6aba]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VaeKnyDk'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce8e888-ff03-45a4-bb36-a6ccfc81a905]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4214ab3d-6ce9-4608-9737-ef9b23afab19]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[957730a7-b174-4641-8dcd-cacabcfef427]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4, portal: 172.16.0.220,3260]
Apr 17 10:37:26 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[30634a0e-a2e5-4bfd-afb3-6a226985921b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[100be0a2-8ef3-4417-802b-4a67b329ae6c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:27 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:27 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:27 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:27 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:27 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:27 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:27 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:27 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:27 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:27 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] HCTL ('42', '-', '-', 0) found on session 15 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c271ca49-2fbc-47f6-9584-dae23002c62f]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG nova.compute.manager [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-changed-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG nova.compute.manager [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing instance network info cache due to event network-changed-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] Acquiring lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] Acquired lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG nova.network.neutron [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Refreshing network info cache for port 4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] swap_volume: Updating volume 15d9e421-b60b-4e95-8794-1b0ee1777ae2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "lUBVRNbG", "auth_password": "Yd9gPXZvyIMQkj", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "c9c51694-0e80-4e17-8d79-5c0c1563a356"}, "status": "reserved", "instance": "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d", "attached_at": "", "detached_at": "", "volume_id": "c9c51694-0e80-4e17-8d79-5c0c1563a356", "serial": "c9c51694-0e80-4e17-8d79-5c0c1563a356"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c9c51694-0e80-4e17-8d79-5c0c1563a356', 'no_device': None, 'attachment_id': '0da34260-96c8-4ab2-a255-f669382f5fc4'} {{(pid=82522) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 17 10:37:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.175s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaeKnyDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== connect_volume: return (1670ms) {'type': 'block', 'scsi_wwn': '23836656538343430', 'path': '/dev/sdk'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836656538343430', 'path': '/dev/sdk'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.objects.instance [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:37:28 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:37:28 user nova-compute[82522]:   <source dev="/dev/sdk"/>
Apr 17 10:37:28 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:37:28 user nova-compute[82522]:   <serial>9cb32346-a238-439d-8ae8-b87c782d41d4</serial>
Apr 17 10:37:28 user nova-compute[82522]: </disk>
Apr 17 10:37:28 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No VIF found with MAC fa:16:3e:f8:08:93, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.network.neutron [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updated VIF entry in instance network info cache for port 4ea57433-f4d1-4edf-ac36-c8099ce1cd8e. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.network.neutron [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [{"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] Releasing lock "refresh_cache-250f2cd2-b6ba-4a89-921f-cbd21ac36525" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.145s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-changed-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing instance network info cache due to event network-changed-acaf0b67-4938-4a01-ac74-86f0935046eb. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] Acquiring lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] Acquired lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:37:28 user nova-compute[82522]: DEBUG nova.network.neutron [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Refreshing network info cache for port acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:29 user nova-compute[82522]: INFO nova.compute.manager [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Detaching volume c9c51694-0e80-4e17-8d79-5c0c1563a356
Apr 17 10:37:29 user nova-compute[82522]: INFO nova.virt.block_device [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Attempting to driver detach volume c9c51694-0e80-4e17-8d79-5c0c1563a356 from mountpoint /dev/vdb
Apr 17 10:37:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Attempting to detach device vdb from instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:37:29 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:37:29 user nova-compute[82522]:   <source dev="/dev/sdi"/>
Apr 17 10:37:29 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:37:29 user nova-compute[82522]:   <serial>c9c51694-0e80-4e17-8d79-5c0c1563a356</serial>
Apr 17 10:37:29 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:37:29 user nova-compute[82522]: </disk>
Apr 17 10:37:29 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:37:29 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Successfully detached device vdb from instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d from the persistent domain config.
Apr 17 10:37:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:37:29 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:37:29 user nova-compute[82522]:   <source dev="/dev/sdi"/>
Apr 17 10:37:29 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:37:29 user nova-compute[82522]:   <serial>c9c51694-0e80-4e17-8d79-5c0c1563a356</serial>
Apr 17 10:37:29 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:37:29 user nova-compute[82522]: </disk>
Apr 17 10:37:29 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:29 user nova-compute[82522]: INFO nova.compute.manager [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Terminating instance
Apr 17 10:37:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681727849.9273138, 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:37:29 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Successfully detached device vdb from instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d from the live domain config.
Apr 17 10:37:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUBVRNbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'c9c51694-0e80-4e17-8d79-5c0c1563a356': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:29 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d35ad2-9592-4aed-b50d-9b1053c34160]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:29 user nova-compute[82522]: No targets found.
Apr 17 10:37:29 user nova-compute[82522]: iSNS:
Apr 17 10:37:29 user nova-compute[82522]: No targets found.
Apr 17 10:37:29 user nova-compute[82522]: STATIC:
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7
Apr 17 10:37:29 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:29 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:29 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:29 user nova-compute[82522]: No targets found.
Apr 17 10:37:29 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:29 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:29 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6ef28f-491f-4f03-9360-becc65b4e85f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[43502983-e2dd-4b3f-a0aa-2544809dae5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2a4709d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356'): ({'sdi'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Removing single pathed devices sdi {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updated VIF entry in instance network info cache for port acaf0b67-4938-4a01-ac74-86f0935046eb. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [{"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cad32dd-58e5-41b0-9767-b831f5c5d5af]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] Releasing lock "refresh_cache-1f120f04-ecbf-496e-81c9-dcfed9084064" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[582d5454-541c-4d37-afde-b37566730af8]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Flushing IO for device /dev/sdi {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd50343-9f16-419a-875a-f8db116f88e2]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-unplugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.066s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f023e61-4e4f-43a6-a164-9286441a5942]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] SCSI volumes sdi have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f3d597-0ec6-4c8b-8dba-9f232f3cdd6b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-unplugged-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-c3988098-5dbd-47e1-896c-6a2b6415f64d for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a37fb8-2bdc-4070-ab8a-9d3b9039d4a3]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260]
Apr 17 10:37:30 user nova-compute[82522]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c51694-0e80-4e17-8d79-5c0c1563a356 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e7455d-4927-4d4b-9edd-76a5d41fab10]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.508s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] <== disconnect_volume: return (508ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-unplugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:30 user nova-compute[82522]: WARNING nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance with vm_state active and task_state deleting.
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-unplugged-77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-77da47f6-f251-457d-b4c9-a2687922abc5 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-77da47f6-f251-457d-b4c9-a2687922abc5 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:30 user nova-compute[82522]: WARNING nova.compute.manager [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-77da47f6-f251-457d-b4c9-a2687922abc5 for instance with vm_state active and task_state deleting.
Apr 17 10:37:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:31 user nova-compute[82522]: INFO nova.compute.manager [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Terminating instance
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Instance destroyed successfully.
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.objects.instance [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lazy-loading 'resources' on Instance uuid 250f2cd2-b6ba-4a89-921f-cbd21ac36525 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=4ea57433-f4d1-4edf-ac36-c8099ce1cd8e,network=Network(6256e79c-cac6-4326-ab0a-322a4d5c61f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea57433-f4') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=4ea57433-f4d1-4edf-ac36-c8099ce1cd8e,network=Network(6256e79c-cac6-4326-ab0a-322a4d5c61f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea57433-f4') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ea57433-f4, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: INFO os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=4ea57433-f4d1-4edf-ac36-c8099ce1cd8e,network=Network(6256e79c-cac6-4326-ab0a-322a4d5c61f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea57433-f4')
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:70:9f,bridge_name='br-int',has_traffic_filtering=True,id=03ae70e4-ee40-4b09-a38b-a819ee74d880,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03ae70e4-ee') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:70:9f,bridge_name='br-int',has_traffic_filtering=True,id=03ae70e4-ee40-4b09-a38b-a819ee74d880,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03ae70e4-ee') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03ae70e4-ee, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: INFO os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:70:9f,bridge_name='br-int',has_traffic_filtering=True,id=03ae70e4-ee40-4b09-a38b-a819ee74d880,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03ae70e4-ee')
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:8b:69,bridge_name='br-int',has_traffic_filtering=True,id=77da47f6-f251-457d-b4c9-a2687922abc5,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77da47f6-f2') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8b:69,bridge_name='br-int',has_traffic_filtering=True,id=77da47f6-f251-457d-b4c9-a2687922abc5,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77da47f6-f2') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77da47f6-f2, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: INFO os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8b:69,bridge_name='br-int',has_traffic_filtering=True,id=77da47f6-f251-457d-b4c9-a2687922abc5,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77da47f6-f2')
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f9:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ea3a20e-3d8d-4cab-9783-0a22cab2e27b,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3a20e-3d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f9:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ea3a20e-3d8d-4cab-9783-0a22cab2e27b,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3a20e-3d') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ea3a20e-3d, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: WARNING nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-03ae70e4-ee40-4b09-a38b-a819ee74d880 for instance with vm_state active and task_state deleting.
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-unplugged-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-acaf0b67-4938-4a01-ac74-86f0935046eb for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: WARNING nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-acaf0b67-4938-4a01-ac74-86f0935046eb for instance with vm_state active and task_state deleting.
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-unplugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: INFO os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f9:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ea3a20e-3d8d-4cab-9783-0a22cab2e27b,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3a20e-3d')
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "address": "fa:16:3e:7e:db:c5", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3988098-5d", "ovs_interfaceid": "c3988098-5dbd-47e1-896c-6a2b6415f64d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:db:c5,bridge_name='br-int',has_traffic_filtering=True,id=c3988098-5dbd-47e1-896c-6a2b6415f64d,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3988098-5d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:db:c5,bridge_name='br-int',has_traffic_filtering=True,id=c3988098-5dbd-47e1-896c-6a2b6415f64d,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3988098-5d') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3988098-5d, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: WARNING nova.compute.manager [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-c3988098-5dbd-47e1-896c-6a2b6415f64d for instance with vm_state active and task_state deleting.
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-unplugged-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-552d9aee-fdf7-4e99-8521-604486e3f888 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: INFO os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:db:c5,bridge_name='br-int',has_traffic_filtering=True,id=c3988098-5dbd-47e1-896c-6a2b6415f64d,network=Network(8bad3f52-f1e9-4477-a5af-235be277d5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3988098-5d')
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:f8:a9,bridge_name='br-int',has_traffic_filtering=True,id=2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aeeb2c5-6b') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:f8:a9,bridge_name='br-int',has_traffic_filtering=True,id=2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aeeb2c5-6b') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2aeeb2c5-6b, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: INFO os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:f8:a9,bridge_name='br-int',has_traffic_filtering=True,id=2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aeeb2c5-6b')
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-154424156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-154424156',id=9,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g==',key_name='tempest-keypair-2090401125',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553d324884a4e5785c896d76b2a9376',ramdisk_id='',reservation_id='r-1euf0s4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-615877170',owner_user_name='tempest-TaggedBootDevicesTest-615877170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41eaa1a7dc224ec4bd8ebd5fdef1fbeb',uuid=250f2cd2-b6ba-4a89-921f-cbd21ac36525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converting VIF {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:93:37,bridge_name='br-int',has_traffic_filtering=True,id=9df6de54-e8fe-425b-a344-de73c3cc5d3e,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df6de54-e8') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:93:37,bridge_name='br-int',has_traffic_filtering=True,id=9df6de54-e8fe-425b-a344-de73c3cc5d3e,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df6de54-e8') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9df6de54-e8, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-unplugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: WARNING nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance with vm_state active and task_state deleting.
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-unplugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: WARNING nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance with vm_state active and task_state deleting.
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-unplugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-unplugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-plugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Acquiring lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] No waiting events found dispatching network-vif-plugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: WARNING nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received unexpected event network-vif-plugged-9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance with vm_state active and task_state deleting.
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-unplugged-5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-5ead9709-8869-4070-81f0-1e397c5ba789 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-5ead9709-8869-4070-81f0-1e397c5ba789 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:32 user nova-compute[82522]: WARNING nova.compute.manager [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-5ead9709-8869-4070-81f0-1e397c5ba789 for instance with vm_state active and task_state deleting.
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: INFO os_vif [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:93:37,bridge_name='br-int',has_traffic_filtering=True,id=9df6de54-e8fe-425b-a344-de73c3cc5d3e,network=Network(0ec736fc-747d-4ae4-a8c2-cd45c718cf1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df6de54-e8')
Apr 17 10:37:32 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Instance destroyed successfully.
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.objects.instance [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lazy-loading 'resources' on Instance uuid 1f120f04-ecbf-496e-81c9-dcfed9084064 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpKeSwsC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:32 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:63:a8,bridge_name='br-int',has_traffic_filtering=True,id=acaf0b67-4938-4a01-ac74-86f0935046eb,network=Network(ab4771c2-e461-463d-9c08-c52f0fa689d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaf0b67-49') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:63:a8,bridge_name='br-int',has_traffic_filtering=True,id=acaf0b67-4938-4a01-ac74-86f0935046eb,network=Network(ab4771c2-e461-463d-9c08-c52f0fa689d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaf0b67-49') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacaf0b67-49, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1223bd6d-9646-49b0-bf55-94ea1fe98c88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:33 user nova-compute[82522]: No targets found.
Apr 17 10:37:33 user nova-compute[82522]: iSNS:
Apr 17 10:37:33 user nova-compute[82522]: No targets found.
Apr 17 10:37:33 user nova-compute[82522]: STATIC:
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:33 user nova-compute[82522]: No targets found.
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:33 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:33 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb38b6ce-05f2-423f-8f62-b485e49cc139]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fffd18a-3b0d-4cc8-9a29-e138bfe415b0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7cd8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e'): ({'sde'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Removing single pathed devices sde {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: INFO os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:63:a8,bridge_name='br-int',has_traffic_filtering=True,id=acaf0b67-4938-4a01-ac74-86f0935046eb,network=Network(ab4771c2-e461-463d-9c08-c52f0fa689d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaf0b67-49')
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:09,bridge_name='br-int',has_traffic_filtering=True,id=5ead9709-8869-4070-81f0-1e397c5ba789,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ead9709-88') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:09,bridge_name='br-int',has_traffic_filtering=True,id=5ead9709-8869-4070-81f0-1e397c5ba789,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ead9709-88') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a315d29d-9adc-4fd1-a157-7d88b26ecec3]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ead9709-88, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b8ea09-ef65-4593-8f1c-a4c05410865b]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Flushing IO for device /dev/sde {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[01258903-4679-4241-b6a9-584af544a41b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: INFO os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:09,bridge_name='br-int',has_traffic_filtering=True,id=5ead9709-8869-4070-81f0-1e397c5ba789,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ead9709-88')
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:bd,bridge_name='br-int',has_traffic_filtering=True,id=b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb2b605c5-b5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:bd,bridge_name='br-int',has_traffic_filtering=True,id=b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb2b605c5-b5') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2b605c5-b5, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab9102d-84b5-41cb-9344-2a5e664c6ed3]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e630c734-fa8b-4891-b8cf-1b649334f073]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:33 user nova-compute[82522]: INFO os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:bd,bridge_name='br-int',has_traffic_filtering=True,id=b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb2b605c5-b5')
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1e:c1,bridge_name='br-int',has_traffic_filtering=True,id=74fde78e-82b3-43f3-9c87-2b754a4bd66f,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fde78e-82') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1e:c1,bridge_name='br-int',has_traffic_filtering=True,id=74fde78e-82b3-43f3-9c87-2b754a4bd66f,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fde78e-82') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74fde78e-82, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lazy-loading 'flavor' on Instance uuid 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: INFO os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1e:c1,bridge_name='br-int',has_traffic_filtering=True,id=74fde78e-82b3-43f3-9c87-2b754a4bd66f,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fde78e-82')
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a0:b7,bridge_name='br-int',has_traffic_filtering=True,id=b3872258-192d-4118-b77a-98dee0f21115,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3872258-19') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a0:b7,bridge_name='br-int',has_traffic_filtering=True,id=b3872258-192d-4118-b77a-98dee0f21115,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3872258-19') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3872258-19, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a337ad5d-adee-4ff7-8b59-c4b8b6219632]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e, portal: 172.16.0.220,3260]
Apr 17 10:37:33 user nova-compute[82522]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.245s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:33 user nova-compute[82522]: INFO os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a0:b7,bridge_name='br-int',has_traffic_filtering=True,id=b3872258-192d-4118-b77a-98dee0f21115,network=Network(07734509-5069-44dc-8e4b-1c83d4b01c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3872258-19')
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "d6c1ba60-17a7-41b4-85df-afed37da4170", "address": "fa:16:3e:68:97:d9", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c1ba60-17", "ovs_interfaceid": "d6c1ba60-17a7-41b4-85df-afed37da4170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:97:d9,bridge_name='br-int',has_traffic_filtering=True,id=d6c1ba60-17a7-41b4-85df-afed37da4170,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c1ba60-17') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:97:d9,bridge_name='br-int',has_traffic_filtering=True,id=d6c1ba60-17a7-41b4-85df-afed37da4170,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c1ba60-17') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6c1ba60-17, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46647c48-1076-472f-90b1-7e19985bfa7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7007eb39-7084-4d2c-974f-04d6b0422933]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] <== disconnect_volume: return (428ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: INFO os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:97:d9,bridge_name='br-int',has_traffic_filtering=True,id=d6c1ba60-17a7-41b4-85df-afed37da4170,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c1ba60-17')
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:35:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-238332109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-238332109',id=10,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q==',key_name='tempest-keypair-1616755361',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5c3233510fa4ef1bb876bd6ee37a443',ramdisk_id='',reservation_id='r-i2yq9nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-99130841',owner_user_name='tempest-TaggedBootDevicesTest_v242-99130841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='245581ebc4824aa7addd4d4272d4a47d',uuid=1f120f04-ecbf-496e-81c9-dcfed9084064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converting VIF {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:4c:35,bridge_name='br-int',has_traffic_filtering=True,id=552d9aee-fdf7-4e99-8521-604486e3f888,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552d9aee-fd') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:4c:35,bridge_name='br-int',has_traffic_filtering=True,id=552d9aee-fdf7-4e99-8521-604486e3f888,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552d9aee-fd') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap552d9aee-fd, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqsLrwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:33 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: INFO os_vif [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:4c:35,bridge_name='br-int',has_traffic_filtering=True,id=552d9aee-fdf7-4e99-8521-604486e3f888,network=Network(595a5463-db90-4c81-8ed2-6e5e2f918cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552d9aee-fd')
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqaXNnjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:33 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e3d3a7-60b2-4d80-bfe7-44621eb2a9ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:33 user nova-compute[82522]: No targets found.
Apr 17 10:37:33 user nova-compute[82522]: iSNS:
Apr 17 10:37:33 user nova-compute[82522]: No targets found.
Apr 17 10:37:33 user nova-compute[82522]: STATIC:
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:33 user nova-compute[82522]: No targets found.
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:33 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:33 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[361d9a1d-3880-45f9-8988-5f3c21d74984]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[550f6c47-fe27-4fb3-94d4-8d29666d4783]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28442feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7'): ({'sdg'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Removing single pathed devices sdg {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0a7ae6-00b2-41a2-aea2-7b0bd465cfbb]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cfa716-f1b3-48a5-b6e1-11f9cc33e46f]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Flushing IO for device /dev/sdg {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fac7c1-77dd-4c49-a73b-8effe17e3183]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[471ed8b4-7978-4f17-99cd-044a366da7c2]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] SCSI volumes sdg have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e81fa6-6c25-48c8-a3b9-67fface91318]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[020a7f74-62b7-457f-854d-4186e0ba1c9d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7, portal: 172.16.0.220,3260]
Apr 17 10:37:33 user nova-compute[82522]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf5c72f-e6de-4173-b335-076e979303d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8ecb42-9c8b-4542-b0bc-e1b94c3cb9a5]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] <== disconnect_volume: return (359ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.347s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgncdmCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:33 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[24978d63-875c-445c-be0d-a83aa2c01629]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:33 user nova-compute[82522]: No targets found.
Apr 17 10:37:33 user nova-compute[82522]: iSNS:
Apr 17 10:37:33 user nova-compute[82522]: No targets found.
Apr 17 10:37:33 user nova-compute[82522]: STATIC:
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:33 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:33 user nova-compute[82522]: No targets found.
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:33 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:33 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[34367875-7141-402b-999e-70d2d910740b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b8a23c-cf16-41c7-8050-daaa305c3a53]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7de4700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb89666-f588-41bb-b6f9-fcc9dcbf0744]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8b28e6-818c-4832-9c4f-d3c33f65e4bb]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e54139e-66ee-4209-9ba0-833f35a15795]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1fa079-d31a-4cb5-ad37-0836760b18f1]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3611f77-7bd9-440f-b421-468696dfd4a8]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d49afdb-5c29-4726-9cae-35b94f6f3441]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021, portal: 172.16.0.220,3260]
Apr 17 10:37:34 user nova-compute[82522]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b078c60-dd3a-40a5-b5cf-61f0546b7021 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee6c873-c184-480a-bb0f-7290347c3258]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] <== disconnect_volume: return (701ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.353s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'covqTbmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:34 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d5f4aa-a98f-48eb-9614-3ec0d7c48539]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:34 user nova-compute[82522]: No targets found.
Apr 17 10:37:34 user nova-compute[82522]: iSNS:
Apr 17 10:37:34 user nova-compute[82522]: No targets found.
Apr 17 10:37:34 user nova-compute[82522]: STATIC:
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:34 user nova-compute[82522]: No targets found.
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:34 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:34 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763d59b-46f4-4658-8c53-dd5e50f99117]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ba6c74-87a3-429b-9863-b73ed6a92c09]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b4a91fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02'): ({'sdc'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Removing single pathed devices sdc {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b45d6c-cd62-487e-97ba-243057f6ebd4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[19308ba5-5e2d-4f51-a42b-30998dc3644a]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Flushing IO for device /dev/sdc {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5f8e1e-2721-4991-9a21-a121c395d7ed]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1184132-3fd3-465c-83b1-6c16f2cf2a9a]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[418e31e5-c88c-4db5-8857-b06b31085657]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:34 user nova-compute[82522]: WARNING nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance with vm_state active and task_state deleting.
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-unplugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:34 user nova-compute[82522]: WARNING nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 for instance with vm_state active and task_state deleting.
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-unplugged-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-b3872258-192d-4118-b77a-98dee0f21115 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:34 user nova-compute[82522]: WARNING nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-b3872258-192d-4118-b77a-98dee0f21115 for instance with vm_state active and task_state deleting.
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-unplugged-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-unplugged-d6c1ba60-17a7-41b4-85df-afed37da4170 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:34 user nova-compute[82522]: WARNING nova.compute.manager [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-d6c1ba60-17a7-41b4-85df-afed37da4170 for instance with vm_state active and task_state deleting.
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d03928c-8495-47dd-93b4-5971380dd9fb]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02, portal: 172.16.0.220,3260]
Apr 17 10:37:34 user nova-compute[82522]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c283ca4-fc93-4f5f-ba1d-3190871dea02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13a3bc4-14bd-43c4-bece-f66f6e0d7fba]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] <== disconnect_volume: return (682ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:34 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Deleting instance files /opt/stack/data/nova/instances/250f2cd2-b6ba-4a89-921f-cbd21ac36525_del
Apr 17 10:37:34 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Deletion of /opt/stack/data/nova/instances/250f2cd2-b6ba-4a89-921f-cbd21ac36525_del complete
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.332s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eca9ff0-59ab-429b-be4f-566a749e43c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:34 user nova-compute[82522]: No targets found.
Apr 17 10:37:34 user nova-compute[82522]: iSNS:
Apr 17 10:37:34 user nova-compute[82522]: No targets found.
Apr 17 10:37:34 user nova-compute[82522]: STATIC:
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:34 user nova-compute[82522]: No targets found.
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:34 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:34 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e99819d-9d59-474e-9603-3eeaba93f10b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: INFO nova.compute.manager [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Took 5.14 seconds to destroy the instance on the hypervisor.
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92ac556-3323-49eb-8f1b-2558773da5e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7cdbd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569'): ({'sdd'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Removing single pathed devices sdd {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f0852-e1ae-4568-bde3-31b91625923f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9803b51a-95f8-440e-b110-273eae31ef72]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Flushing IO for device /dev/sdd {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb99b2b-45cc-4190-aa4e-c3ccd57fba86]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[680a97d1-377c-4b7d-a334-5fe825d8a36d]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acf1a61-7791-45a3-8828-b7eb524d9015]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f33f77-3925-44e3-bbe2-f85914cd11d4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569, portal: 172.16.0.220,3260]
Apr 17 10:37:34 user nova-compute[82522]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-plugged-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] Acquiring lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] No waiting events found dispatching network-vif-plugged-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:37:34 user nova-compute[82522]: WARNING nova.compute.manager [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received unexpected event network-vif-plugged-552d9aee-fdf7-4e99-8521-604486e3f888 for instance with vm_state active and task_state deleting.
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e23bb78-786c-40bf-abd6-6ab77d4ed569 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ff347-c0ad-46ab-a59d-306e8975d9d5]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] <== disconnect_volume: return (650ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQRqkvlt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:34 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bbbdcf-202a-47e9-8e08-ffeff033eaa3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:34 user nova-compute[82522]: No targets found.
Apr 17 10:37:34 user nova-compute[82522]: iSNS:
Apr 17 10:37:34 user nova-compute[82522]: No targets found.
Apr 17 10:37:34 user nova-compute[82522]: STATIC:
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:34 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:34 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:34 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:34 user nova-compute[82522]: No targets found.
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:34 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:34 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b72dbc-5a8f-4221-9e17-e51c79f80cf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d90155-aa22-453b-847e-90b05770450a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2845408b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15'): ({'sdf'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Removing single pathed devices sdf {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb454e7-33d1-4bc1-90d3-5f3b723e9287]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d1ede-0c82-43f0-87a0-e178c929e393]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Flushing IO for device /dev/sdf {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a86444-7efb-4a34-9691-d4a611b03df3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f7af11-9d42-4c05-a814-10c72a625ba5]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[002ddb89-2cd7-4cdc-b6d1-f14898202f17]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f8e260-8515-41bf-aa44-a6a09fb74be7]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15, portal: 172.16.0.220,3260]
Apr 17 10:37:35 user nova-compute[82522]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb93d4e-544e-4909-9b87-72ea32bd3e15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba69a76f-ce58-4926-b94b-f7880ce3e9f6]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] <== disconnect_volume: return (321ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Deleting instance files /opt/stack/data/nova/instances/1f120f04-ecbf-496e-81c9-dcfed9084064_del
Apr 17 10:37:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Deletion of /opt/stack/data/nova/instances/1f120f04-ecbf-496e-81c9-dcfed9084064_del complete
Apr 17 10:37:35 user nova-compute[82522]: INFO nova.compute.manager [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Took 4.09 seconds to destroy the instance on the hypervisor.
Apr 17 10:37:35 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:37:35 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:37:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-deleted-c3988098-5dbd-47e1-896c-6a2b6415f64d {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:37 user nova-compute[82522]: INFO nova.compute.manager [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Neutron deleted interface c3988098-5dbd-47e1-896c-6a2b6415f64d; detaching it from the instance and deleting it from the info cache
Apr 17 10:37:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [{"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "address": "fa:16:3e:70:f8:a9", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aeeb2c5-6b", "ovs_interfaceid": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Detach interface failed, port_id=c3988098-5dbd-47e1-896c-6a2b6415f64d, reason: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:37:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-deleted-2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:39 user nova-compute[82522]: INFO nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Neutron deleted interface 2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38; detaching it from the instance and deleting it from the info cache
Apr 17 10:37:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [{"id": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "address": "fa:16:3e:0b:2c:f8", "network": {"id": "6256e79c-cac6-4326-ab0a-322a4d5c61f3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1878379703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea57433-f4", "ovs_interfaceid": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Detach interface failed, port_id=2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38, reason: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:37:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-deleted-d6c1ba60-17a7-41b4-85df-afed37da4170 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:39 user nova-compute[82522]: INFO nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Neutron deleted interface d6c1ba60-17a7-41b4-85df-afed37da4170; detaching it from the instance and deleting it from the info cache
Apr 17 10:37:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [{"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3872258-192d-4118-b77a-98dee0f21115", "address": "fa:16:3e:63:a0:b7", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3872258-19", "ovs_interfaceid": "b3872258-192d-4118-b77a-98dee0f21115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Detach interface failed, port_id=d6c1ba60-17a7-41b4-85df-afed37da4170, reason: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:37:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-deleted-b3872258-192d-4118-b77a-98dee0f21115 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:39 user nova-compute[82522]: INFO nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Neutron deleted interface b3872258-192d-4118-b77a-98dee0f21115; detaching it from the instance and deleting it from the info cache
Apr 17 10:37:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [{"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552d9aee-fdf7-4e99-8521-604486e3f888", "address": "fa:16:3e:70:4c:35", "network": {"id": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "bridge": "br-int", "label": "tempest-device-tagging-net2-113255598", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552d9aee-fd", "ovs_interfaceid": "552d9aee-fdf7-4e99-8521-604486e3f888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Detach interface failed, port_id=b3872258-192d-4118-b77a-98dee0f21115, reason: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:37:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-deleted-4ea57433-f4d1-4edf-ac36-c8099ce1cd8e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:40 user nova-compute[82522]: INFO nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Neutron deleted interface 4ea57433-f4d1-4edf-ac36-c8099ce1cd8e; detaching it from the instance and deleting it from the info cache
Apr 17 10:37:40 user nova-compute[82522]: DEBUG nova.network.neutron [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [{"id": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "address": "fa:16:3e:09:70:9f", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ae70e4-ee", "ovs_interfaceid": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77da47f6-f251-457d-b4c9-a2687922abc5", "address": "fa:16:3e:da:8b:69", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77da47f6-f2", "ovs_interfaceid": "77da47f6-f251-457d-b4c9-a2687922abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "address": "fa:16:3e:bb:f9:d7", "network": {"id": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-497785518", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3a20e-3d", "ovs_interfaceid": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "address": "fa:16:3e:77:93:37", "network": {"id": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "bridge": "br-int", "label": "tempest-device-tagging-net2-801099009", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a553d324884a4e5785c896d76b2a9376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df6de54-e8", "ovs_interfaceid": "9df6de54-e8fe-425b-a344-de73c3cc5d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Detach interface failed, port_id=4ea57433-f4d1-4edf-ac36-c8099ce1cd8e, reason: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:37:41 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:41 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Took 6.95 seconds to deallocate network for instance.
Apr 17 10:37:41 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-deleted-552d9aee-fdf7-4e99-8521-604486e3f888 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:41 user nova-compute[82522]: INFO nova.compute.manager [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Neutron deleted interface 552d9aee-fdf7-4e99-8521-604486e3f888; detaching it from the instance and deleting it from the info cache
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [{"id": "acaf0b67-4938-4a01-ac74-86f0935046eb", "address": "fa:16:3e:4a:63:a8", "network": {"id": "ab4771c2-e461-463d-9c08-c52f0fa689d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1047304758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaf0b67-49", "ovs_interfaceid": "acaf0b67-4938-4a01-ac74-86f0935046eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:42 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Took 6.81 seconds to deallocate network for instance.
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Detach interface failed, port_id=552d9aee-fdf7-4e99-8521-604486e3f888, reason: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-deleted-0ea3a20e-3d8d-4cab-9783-0a22cab2e27b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Received event network-vif-deleted-9df6de54-e8fe-425b-a344-de73c3cc5d3e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-deleted-acaf0b67-4938-4a01-ac74-86f0935046eb {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:42 user nova-compute[82522]: INFO nova.compute.manager [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Neutron deleted interface acaf0b67-4938-4a01-ac74-86f0935046eb; detaching it from the instance and deleting it from the info cache
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [{"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "address": "fa:16:3e:ba:1e:c1", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fde78e-82", "ovs_interfaceid": "74fde78e-82b3-43f3-9c87-2b754a4bd66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Detach interface failed, port_id=acaf0b67-4938-4a01-ac74-86f0935046eb, reason: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:37:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:42 user nova-compute[82522]: INFO nova.compute.manager [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Detaching volume 9cb32346-a238-439d-8ae8-b87c782d41d4
Apr 17 10:37:42 user nova-compute[82522]: INFO nova.virt.block_device [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attempting to driver detach volume 9cb32346-a238-439d-8ae8-b87c782d41d4 from mountpoint /dev/vdb
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Attempting to detach device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:37:42 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:37:42 user nova-compute[82522]:   <source dev="/dev/sdk"/>
Apr 17 10:37:42 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:37:42 user nova-compute[82522]:   <serial>9cb32346-a238-439d-8ae8-b87c782d41d4</serial>
Apr 17 10:37:42 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:37:42 user nova-compute[82522]: </disk>
Apr 17 10:37:42 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:37:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully detached device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the persistent domain config.
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7792cf72-dc73-4201-9501-4515ce860735 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:37:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:37:42 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:37:42 user nova-compute[82522]:   <source dev="/dev/sdk"/>
Apr 17 10:37:42 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:37:42 user nova-compute[82522]:   <serial>9cb32346-a238-439d-8ae8-b87c782d41d4</serial>
Apr 17 10:37:42 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:37:42 user nova-compute[82522]: </disk>
Apr 17 10:37:42 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681727863.28699, 7792cf72-dc73-4201-9501-4515ce860735 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:37:43 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully detached device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the live domain config.
Apr 17 10:37:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaeKnyDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:37:43 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5c1380-35f6-437c-a0af-fd9647969b6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:37:43 user nova-compute[82522]: No targets found.
Apr 17 10:37:43 user nova-compute[82522]: iSNS:
Apr 17 10:37:43 user nova-compute[82522]: No targets found.
Apr 17 10:37:43 user nova-compute[82522]: STATIC:
Apr 17 10:37:43 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4
Apr 17 10:37:43 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:43 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:43 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:37:43 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:43 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:43 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:37:43 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:37:43 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:37:43 user nova-compute[82522]: FIRMWARE:
Apr 17 10:37:43 user nova-compute[82522]: No targets found.
Apr 17 10:37:43 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:37:43 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:37:43 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb6f987-ae7d-4684-ac98-a8c40b695a5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6171d1-9617-4838-ae7a-fe975855d66c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:43 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:43 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:43 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:37:43 user nova-compute[82522]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 (non-flash)
Apr 17 10:37:43 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:37:43 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7cda290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4'): ({'sdk'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Removing single pathed devices sdk {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b731499c-78bf-4ce3-b88c-7b305760d034]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[db93b9f8-2eef-4ed6-a3e5-6e672d086ce8]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Flushing IO for device /dev/sdk {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9139d29c-776b-41f9-8665-9bd7f58af851]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[815b48d9-6d53-42d4-bb30-3c080650c8b4]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] SCSI volumes sdk have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf7ae4-f1cc-47c9-9187-fbfa5b52477b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e96f043-2274-4e85-aedf-26053326f9bc]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4, portal: 172.16.0.220,3260]
Apr 17 10:37:43 user nova-compute[82522]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4, portal: 172.16.0.220,3260] successful.
Apr 17 10:37:43 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb32346-a238-439d-8ae8-b87c782d41d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743d3c3-f9e0-4ae6-a05b-a9cecb265719]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== disconnect_volume: return (325ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:37:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:37:44 user nova-compute[82522]: INFO nova.compute.manager [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Took 2.54 seconds to detach 3 volumes for instance.
Apr 17 10:37:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Received event network-vif-deleted-74fde78e-82b3-43f3-9c87-2b754a4bd66f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:37:44 user nova-compute[82522]: INFO nova.compute.manager [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Neutron deleted interface 74fde78e-82b3-43f3-9c87-2b754a4bd66f; detaching it from the instance and deleting it from the info cache
Apr 17 10:37:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Updating instance_info_cache with network_info: [{"id": "5ead9709-8869-4070-81f0-1e397c5ba789", "address": "fa:16:3e:d2:d6:09", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ead9709-88", "ovs_interfaceid": "5ead9709-8869-4070-81f0-1e397c5ba789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "address": "fa:16:3e:bf:e6:bd", "network": {"id": "07734509-5069-44dc-8e4b-1c83d4b01c43", "bridge": "br-int", "label": "tempest-device-tagging-net1-902246380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5c3233510fa4ef1bb876bd6ee37a443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b605c5-b5", "ovs_interfaceid": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:37:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Detach interface failed, port_id=74fde78e-82b3-43f3-9c87-2b754a4bd66f, reason: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:37:44 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:37:44 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:37:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:44 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Deleted allocations for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525
Apr 17 10:37:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "250f2cd2-b6ba-4a89-921f-cbd21ac36525" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.187s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:44 user nova-compute[82522]: DEBUG nova.objects.instance [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:37:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.217s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:45 user nova-compute[82522]: INFO nova.compute.manager [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Took 3.17 seconds to detach 3 volumes for instance.
Apr 17 10:37:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:37:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:37:45 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:37:45 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:37:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:45 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Deleted allocations for instance 1f120f04-ecbf-496e-81c9-dcfed9084064
Apr 17 10:37:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "1f120f04-ecbf-496e-81c9-dcfed9084064" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.518s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:37:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:46 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681727851.340444, 250f2cd2-b6ba-4a89-921f-cbd21ac36525 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:37:46 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] VM Stopped (Lifecycle Event)
Apr 17 10:37:46 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2fb57784-2f08-4f9b-8d3d-fa07d62c146e None None] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:37:47 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681727852.9322739, 1f120f04-ecbf-496e-81c9-dcfed9084064 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:37:47 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] VM Stopped (Lifecycle Event)
Apr 17 10:37:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3458fa4b-1443-4faf-b422-9cd66f295007 None None] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:37:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:37:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:38:00 user nova-compute[82522]: INFO nova.compute.claims [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Claim successful on node user
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.network.neutron [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:38:00 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.policy [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:38:00 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Creating image(s)
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk 1073741824" returned: 0 in 0.054s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG nova.network.neutron [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Successfully created port: 3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Cannot resize image /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG nova.objects.instance [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'migration_context' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Ensure instance console log exists: /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Successfully updated port: 3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquired lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-changed-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Refreshing instance network info cache due to event network-changed-3106e21d-664e-4c17-85be-f0a654c4eabc. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] Acquiring lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updating instance_info_cache with network_info: [{"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Releasing lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Instance network_info: |[{"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] Acquired lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.network.neutron [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Refreshing network info cache for port 3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Start _get_guest_xml network_info=[{"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:38:02 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:02 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1840654553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1840654553',id=12,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA==',key_name='tempest-keypair-1227280417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='507228fb562e461e91a628829ce32d80',ramdisk_id='',reservation_id='r-fakqiiql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1382963185',owner_user_name='tempest-TaggedAttachmentsTest-1382963185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:38:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab512fbd85694415a5f7af8b689814d4',uuid=9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converting VIF {"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:13:f7,bridge_name='br-int',has_traffic_filtering=True,id=3106e21d-664e-4c17-85be-f0a654c4eabc,network=Network(a4860ea0-3765-4c0e-a5dd-6f9f5268734a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3106e21d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.objects.instance [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:38:02 user nova-compute[82522]:   <uuid>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</uuid>
Apr 17 10:38:02 user nova-compute[82522]:   <name>instance-0000000c</name>
Apr 17 10:38:02 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:38:02 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:38:02 user nova-compute[82522]:   <metadata>
Apr 17 10:38:02 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:38:02 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:38:02 user nova-compute[82522]:       <nova:name>tempest-device-tagging-server-1840654553</nova:name>
Apr 17 10:38:02 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:38:02</nova:creationTime>
Apr 17 10:38:02 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:38:02 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:38:02 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:38:02 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:38:02 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:38:02 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:38:02 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:38:02 user nova-compute[82522]:       <nova:owner>
Apr 17 10:38:02 user nova-compute[82522]:         <nova:user uuid="ab512fbd85694415a5f7af8b689814d4">tempest-TaggedAttachmentsTest-1382963185-project-member</nova:user>
Apr 17 10:38:02 user nova-compute[82522]:         <nova:project uuid="507228fb562e461e91a628829ce32d80">tempest-TaggedAttachmentsTest-1382963185</nova:project>
Apr 17 10:38:02 user nova-compute[82522]:       </nova:owner>
Apr 17 10:38:02 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:38:02 user nova-compute[82522]:       <nova:ports>
Apr 17 10:38:02 user nova-compute[82522]:         <nova:port uuid="3106e21d-664e-4c17-85be-f0a654c4eabc">
Apr 17 10:38:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:38:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:38:02 user nova-compute[82522]:       </nova:ports>
Apr 17 10:38:02 user nova-compute[82522]:     </nova:instance>
Apr 17 10:38:02 user nova-compute[82522]:   </metadata>
Apr 17 10:38:02 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:38:02 user nova-compute[82522]:     <system>
Apr 17 10:38:02 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:38:02 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:38:02 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:38:02 user nova-compute[82522]:       <entry name="serial">9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:38:02 user nova-compute[82522]:       <entry name="uuid">9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:38:02 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:38:02 user nova-compute[82522]:     </system>
Apr 17 10:38:02 user nova-compute[82522]:   </sysinfo>
Apr 17 10:38:02 user nova-compute[82522]:   <os>
Apr 17 10:38:02 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:38:02 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:38:02 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:38:02 user nova-compute[82522]:   </os>
Apr 17 10:38:02 user nova-compute[82522]:   <features>
Apr 17 10:38:02 user nova-compute[82522]:     <acpi/>
Apr 17 10:38:02 user nova-compute[82522]:     <apic/>
Apr 17 10:38:02 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:38:02 user nova-compute[82522]:   </features>
Apr 17 10:38:02 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:38:02 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:38:02 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:38:02 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:38:02 user nova-compute[82522]:   </clock>
Apr 17 10:38:02 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:38:02 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:38:02 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:38:02 user nova-compute[82522]:   </cpu>
Apr 17 10:38:02 user nova-compute[82522]:   <devices>
Apr 17 10:38:02 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:38:02 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:38:02 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk"/>
Apr 17 10:38:02 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:38:02 user nova-compute[82522]:     </disk>
Apr 17 10:38:02 user nova-compute[82522]:     <disk type="file" device="cdrom">
Apr 17 10:38:02 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none"/>
Apr 17 10:38:02 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.config"/>
Apr 17 10:38:02 user nova-compute[82522]:       <target dev="hda" bus="ide"/>
Apr 17 10:38:02 user nova-compute[82522]:     </disk>
Apr 17 10:38:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:38:02 user nova-compute[82522]:       <mac address="fa:16:3e:b0:13:f7"/>
Apr 17 10:38:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:38:02 user nova-compute[82522]:       <target dev="tap3106e21d-66"/>
Apr 17 10:38:02 user nova-compute[82522]:     </interface>
Apr 17 10:38:02 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:38:02 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log" append="off"/>
Apr 17 10:38:02 user nova-compute[82522]:     </serial>
Apr 17 10:38:02 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:38:02 user nova-compute[82522]:     <video>
Apr 17 10:38:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:02 user nova-compute[82522]:     </video>
Apr 17 10:38:02 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:38:02 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:38:02 user nova-compute[82522]:     </rng>
Apr 17 10:38:02 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:38:02 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:38:02 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:38:02 user nova-compute[82522]:     </memballoon>
Apr 17 10:38:02 user nova-compute[82522]:   </devices>
Apr 17 10:38:02 user nova-compute[82522]: </domain>
Apr 17 10:38:02 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1840654553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1840654553',id=12,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA==',key_name='tempest-keypair-1227280417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='507228fb562e461e91a628829ce32d80',ramdisk_id='',reservation_id='r-fakqiiql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1382963185',owner_user_name='tempest-TaggedAttachmentsTest-1382963185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:38:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab512fbd85694415a5f7af8b689814d4',uuid=9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converting VIF {"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:13:f7,bridge_name='br-int',has_traffic_filtering=True,id=3106e21d-664e-4c17-85be-f0a654c4eabc,network=Network(a4860ea0-3765-4c0e-a5dd-6f9f5268734a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3106e21d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG os_vif [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:13:f7,bridge_name='br-int',has_traffic_filtering=True,id=3106e21d-664e-4c17-85be-f0a654c4eabc,network=Network(a4860ea0-3765-4c0e-a5dd-6f9f5268734a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3106e21d-66') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3106e21d-66, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3106e21d-66, col_values=(('external_ids', {'iface-id': '3106e21d-664e-4c17-85be-f0a654c4eabc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:13:f7', 'vm-uuid': '9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:02 user nova-compute[82522]: INFO os_vif [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:13:f7,bridge_name='br-int',has_traffic_filtering=True,id=3106e21d-664e-4c17-85be-f0a654c4eabc,network=Network(a4860ea0-3765-4c0e-a5dd-6f9f5268734a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3106e21d-66')
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] No BDM found with device name hda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] No VIF found with MAC fa:16:3e:b0:13:f7, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:38:02 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Using config drive
Apr 17 10:38:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Creating config drive at /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.config
Apr 17 10:38:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgt6qlouh {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgt6qlouh" returned: 0 in 0.056s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:03 user nova-compute[82522]: DEBUG nova.network.neutron [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updated VIF entry in instance network info cache for port 3106e21d-664e-4c17-85be-f0a654c4eabc. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:38:03 user nova-compute[82522]: DEBUG nova.network.neutron [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updating instance_info_cache with network_info: [{"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] Releasing lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-plugged-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] No waiting events found dispatching network-vif-plugged-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:04 user nova-compute[82522]: WARNING nova.compute.manager [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received unexpected event network-vif-plugged-3106e21d-664e-4c17-85be-f0a654c4eabc for instance with vm_state building and task_state spawning.
Apr 17 10:38:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727886.7551684, 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] VM Resumed (Lifecycle Event)
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:38:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Instance spawned successfully.
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727886.7566109, 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] VM Started (Lifecycle Event)
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:38:06 user nova-compute[82522]: INFO nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Took 6.05 seconds to spawn the instance on the hypervisor.
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:06 user nova-compute[82522]: INFO nova.compute.manager [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Took 6.73 seconds to build instance.
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-plugged-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] No waiting events found dispatching network-vif-plugged-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:06 user nova-compute[82522]: WARNING nova.compute.manager [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received unexpected event network-vif-plugged-3106e21d-664e-4c17-85be-f0a654c4eabc for instance with vm_state active and task_state None.
Apr 17 10:38:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.839s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:15 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:38:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Skipping network cache update for instance because it has been migrated to another host. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 17 10:38:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:15 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing instance network info cache due to event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] Acquiring lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] Acquired lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:17 user nova-compute[82522]: DEBUG nova.network.neutron [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:18 user nova-compute[82522]: INFO nova.compute.manager [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Shelve offloading
Apr 17 10:38:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG nova.network.neutron [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updated VIF entry in instance network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG nova.network.neutron [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-unplugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] No waiting events found dispatching network-vif-unplugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:18 user nova-compute[82522]: WARNING nova.compute.manager [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received unexpected event network-vif-unplugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance with vm_state active and task_state shelving.
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:38:18 user nova-compute[82522]: INFO nova.compute.claims [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Claim successful on node user
Apr 17 10:38:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] Releasing lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:38:19 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Instance destroyed successfully.
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.compute.manager [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquired lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.network.neutron [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:38:19 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:38:19 user nova-compute[82522]: INFO nova.virt.block_device [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Booting with blank volume at /dev/vda
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.policy [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:19 user nova-compute[82522]: INFO nova.compute.manager [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Terminating instance
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.compute.manager [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received event network-vif-unplugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.compute.manager [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] No waiting events found dispatching network-vif-unplugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:19 user nova-compute[82522]: DEBUG nova.compute.manager [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received event network-vif-unplugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:38:20 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Instance destroyed successfully.
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lazy-loading 'resources' on Instance uuid 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-450067832',display_name='tempest-TestVolumeSwap-server-450067832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-450067832',id=6,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKwzN5gZwJiLf7kL/Te58BS/o4Hp6lTpWXkF6oFUo6Fvuvh0VO0qHyTu9Tnn1hT7l4fXP9wTcKvNBSlIqYvAeBr+B6hcdfu7buddRuJa0QtQHU7hZJ7nWicTq8L7ShjNw==',key_name='tempest-keypair-1885421127',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:35:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ad2dd86dc14ead939b4fdca5a97a35',ramdisk_id='',reservation_id='r-wfpfga1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1885282809',owner_user_name='tempest-TestVolumeSwap-1885282809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:35:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18c3804bb0449c8bba3b56df41ccc99',uuid=3336cde8-eedb-4d3e-8c20-b79cd2d1f51d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Converting VIF {"id": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "address": "fa:16:3e:f5:52:19", "network": {"id": "25db3f74-3642-482d-8c0d-667e3cdf4e3c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-128468433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad2dd86dc14ead939b4fdca5a97a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01527ff5-7a", "ovs_interfaceid": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:52:19,bridge_name='br-int',has_traffic_filtering=True,id=01527ff5-7a84-4bbf-ae89-ef334a97fc0a,network=Network(25db3f74-3642-482d-8c0d-667e3cdf4e3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01527ff5-7a') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG os_vif [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:52:19,bridge_name='br-int',has_traffic_filtering=True,id=01527ff5-7a84-4bbf-ae89-ef334a97fc0a,network=Network(25db3f74-3642-482d-8c0d-667e3cdf4e3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01527ff5-7a') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01527ff5-7a, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:20 user nova-compute[82522]: INFO os_vif [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:52:19,bridge_name='br-int',has_traffic_filtering=True,id=01527ff5-7a84-4bbf-ae89-ef334a97fc0a,network=Network(25db3f74-3642-482d-8c0d-667e3cdf4e3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01527ff5-7a')
Apr 17 10:38:20 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Deleting instance files /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d_del
Apr 17 10:38:20 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Deletion of /opt/stack/data/nova/instances/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d_del complete
Apr 17 10:38:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:20 user nova-compute[82522]: INFO nova.compute.manager [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.network.neutron [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Releasing lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] No waiting events found dispatching network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:20 user nova-compute[82522]: WARNING nova.compute.manager [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received unexpected event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance with vm_state active and task_state shelving.
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Successfully created port: 2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:38:21 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Error from libvirt while getting description of instance-00000006: [Error Code 42] Domain not found: no domain with matching uuid '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d' (instance-00000006): libvirt.libvirtError: Domain not found: no domain with matching uuid '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d' (instance-00000006)
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing instance network info cache due to event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] Acquiring lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] Acquired lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.network.neutron [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:38:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Instance destroyed successfully.
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lazy-loading 'resources' on Instance uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-906009009',display_name='tempest-TestShelveInstance-server-906009009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-906009009',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH4FFXKqH+g7k0ASGnNDXfUy/R1u6icWp+zf9vlgtMbomh5J54TN/pK57/PFpeGZBHXgpMBfbuezVh6SWpKdljIUuRGib6lK5tHsF/MEgxDHkpa84AcMmldHwjGud+ZtQ==',key_name='tempest-TestShelveInstance-993329906',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a793afb3e7045898c59a77975079d72',ramdisk_id='',reservation_id='r-g168xrnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2028370832',owner_user_name='tempest-TestShelveInstance-2028370832-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:40Z,user_data=None,user_id='b43c0aee7b05459d898e0dc2654262fa',uuid=b0c707ac-b08f-4f18-8262-e1b79d7e17e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converting VIF {"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_vif [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90c85bb7-50, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:21 user nova-compute[82522]: INFO os_vif [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50')
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amnpFeIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:21 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received event network-vif-plugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] Acquiring lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] No waiting events found dispatching network-vif-plugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:21 user nova-compute[82522]: WARNING nova.compute.manager [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received unexpected event network-vif-plugged-01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance with vm_state active and task_state deleting.
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[985fac0a-dcda-4af0-95b9-36da7e69a1ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:38:21 user nova-compute[82522]: No targets found.
Apr 17 10:38:21 user nova-compute[82522]: iSNS:
Apr 17 10:38:21 user nova-compute[82522]: No targets found.
Apr 17 10:38:21 user nova-compute[82522]: STATIC:
Apr 17 10:38:21 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:38:21 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:38:21 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:38:21 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:38:21 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:38:21 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:38:21 user nova-compute[82522]: FIRMWARE:
Apr 17 10:38:21 user nova-compute[82522]: No targets found.
Apr 17 10:38:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:38:21 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:38:21 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a72a87-0b34-43ce-9cdf-633a7cf12de8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b01bad9-d773-47b4-a755-eb3d22c6deb9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:21 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:38:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:21 user nova-compute[82522]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:38:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7cd8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970'): ({'sdh'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Removing single pathed devices sdh {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:38:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[751f61ea-cc3e-4533-a66f-6731ca04ef1a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c5d50b-6575-47ad-9f1e-d0d42e8594a5]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Flushing IO for device /dev/sdh {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65e79d8-3888-4341-963f-d93af62c7580]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.057s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6445fc7e-9088-451e-981d-d80d4cd50d67]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] SCSI volumes sdh have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:22 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:22 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8152MB free_disk=26.650550842285156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb66741-4c32-4eaf-8d74-c75832b84dad]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:22 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Took 2.14 seconds to deallocate network for instance.
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[896e3068-8041-45a5-9d8a-ac7c43b403eb]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260]
Apr 17 10:38:22 user nova-compute[82522]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260] successful.
Apr 17 10:38:22 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb88d0-c2fd-4c49-be1b-cb387df58653]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.766s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] <== disconnect_volume: return (772ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:38:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Deleting instance files /opt/stack/data/nova/instances/b0c707ac-b08f-4f18-8262-e1b79d7e17e1_del
Apr 17 10:38:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Deletion of /opt/stack/data/nova/instances/b0c707ac-b08f-4f18-8262-e1b79d7e17e1_del complete
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Successfully updated port: 2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquired lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 59fd26de-d46e-4f41-91f6-090005a07d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 7792cf72-dc73-4201-9501-4515ce860735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-e2628732-6716-45d8-b72e-ed6d505d1dd0 req-0c37e0da-e331-4b4c-b636-cc9eaaf17659 service nova] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Received event network-vif-deleted-01527ff5-7a84-4bbf-ae89-ef334a97fc0a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:38:22 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.413s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.network.neutron [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updated VIF entry in instance network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.network.neutron [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": null, "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap90c85bb7-50", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] Releasing lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating instance_info_cache with network_info: [{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Releasing lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Instance network_info: |[{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:38:23 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Deleted allocations for instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.020s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:23 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Deleted allocations for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-changed-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Refreshing instance network info cache due to event network-changed-2acfe658-2dce-4086-b24a-ef0b4c3714f8. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] Acquiring lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] Acquired lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.network.neutron [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Refreshing network info cache for port 2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:23 user nova-compute[82522]: DEBUG nova.objects.instance [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lazy-loading 'numa_topology' on Instance uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.930s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG os_brick.utils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b8b775-a61d-4681-b97b-5e4764024ceb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2eac77-a38b-403f-af2b-ae3d70a37a34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fc83d9-3ca7-45d8-90ef-a1f722ec6a0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6d521e-9187-4d86-97c5-4791db7fbdef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:38:24 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[771a6ccb-5864-43f6-9b9e-d3421ac5749c]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG os_brick.utils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating existing volume attachment record: 7e76d82a-4df0-4510-af8f-d38a5cfc55ea {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG nova.network.neutron [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updated VIF entry in instance network info cache for port 2acfe658-2dce-4086-b24a-ef0b4c3714f8. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG nova.network.neutron [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating instance_info_cache with network_info: [{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] Releasing lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:28 user nova-compute[82522]: INFO nova.compute.manager [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Unshelving
Apr 17 10:38:28 user nova-compute[82522]: INFO nova.virt.block_device [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Booting with volume 1e959d4f-1d94-402d-84d5-323e6a987d67 at /dev/vdc
Apr 17 10:38:28 user nova-compute[82522]: DEBUG os_brick.utils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d75f21-7935-411b-b8cc-d44a497db407]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5439d7f2-abf9-4131-97d5-8619f88ed7d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8b5cba-d870-487c-9fc4-79738a903547]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[838c6e75-8260-46c5-91d6-b18e6756cc28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:38:28 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:38:28 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64a8f9d-c591-4274-9afa-42c205a28a42]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG os_brick.utils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:28 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updating existing volume attachment record: caf61358-f70e-4f40-af64-8b4dd020bb0b {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:38:30 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Creating image(s)
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Ensure instance console log exists: /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Start _get_guest_xml network_info=[{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '7e76d82a-4df0-4510-af8f-d38a5cfc55ea', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkayWePI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab', 'attached_at': '', 'detached_at': '', 'volume_id': '263e05e5-5c44-4a01-bf88-51f9038d2169', 'serial': '263e05e5-5c44-4a01-bf88-51f9038d2169'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:38:30 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:30 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkayWePI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:30 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:30 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:30 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a2eeb2-08cf-4682-818e-e57a0f17b6f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:38:30 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f198b95-2e84-485f-a67f-c19d39c0227d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169] added
Apr 17 10:38:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[96819bed-480f-46bf-be51-c5690623f0b7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[263e9252-fe30-4754-a646-66571347304e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BkayWePI {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BkayWePI" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e941125-399d-4288-8af3-63c1a5849455]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BkayWePI'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bc9be1-69b7-4d9b-a481-3dc21069fba3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c4fc8-cbeb-4cd7-9acf-9b5bc0ed1e12]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ae406-4f56-4491-b486-2a21a8646ae8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169, portal: 172.16.0.220,3260]
Apr 17 10:38:30 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169, portal: 172.16.0.220,3260] successful.
Apr 17 10:38:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0951ead4-7747-4f15-9bfb-4cf7df499abb]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10d35e1-3066-4b09-bfc7-7ad978c49f3d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:30 user nova-compute[82522]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:30 user nova-compute[82522]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c875558f-991d-4e90-a474-b2fb5715b960]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:38:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkayWePI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:38:31 user nova-compute[82522]: INFO nova.compute.claims [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Claim successful on node user
Apr 17 10:38:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23566396132313836', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566396132313836', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1770450591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1770450591',id=13,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-zpux0ozq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:38:19Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ce:9e,bridge_name='br-int',has_traffic_filtering=True,id=2acfe658-2dce-4086-b24a-ef0b4c3714f8,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2acfe658-2d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:38:31 user nova-compute[82522]:   <uuid>1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab</uuid>
Apr 17 10:38:31 user nova-compute[82522]:   <name>instance-0000000d</name>
Apr 17 10:38:31 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:38:31 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:38:31 user nova-compute[82522]:   <metadata>
Apr 17 10:38:31 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:38:31 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:38:31 user nova-compute[82522]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1770450591</nova:name>
Apr 17 10:38:31 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:38:30</nova:creationTime>
Apr 17 10:38:31 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:38:31 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:38:31 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:38:31 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:38:31 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:38:31 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:38:31 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:38:31 user nova-compute[82522]:       <nova:owner>
Apr 17 10:38:31 user nova-compute[82522]:         <nova:user uuid="d8cb73d24d324903a625e4782270120e">tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member</nova:user>
Apr 17 10:38:31 user nova-compute[82522]:         <nova:project uuid="faab4afa0ddf45578232627c2fac2ff8">tempest-ServerBootFromVolumeStableRescueTest-933538997</nova:project>
Apr 17 10:38:31 user nova-compute[82522]:       </nova:owner>
Apr 17 10:38:31 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:38:31 user nova-compute[82522]:       <nova:ports>
Apr 17 10:38:31 user nova-compute[82522]:         <nova:port uuid="2acfe658-2dce-4086-b24a-ef0b4c3714f8">
Apr 17 10:38:31 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 10:38:31 user nova-compute[82522]:         </nova:port>
Apr 17 10:38:31 user nova-compute[82522]:       </nova:ports>
Apr 17 10:38:31 user nova-compute[82522]:     </nova:instance>
Apr 17 10:38:31 user nova-compute[82522]:   </metadata>
Apr 17 10:38:31 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:38:31 user nova-compute[82522]:     <system>
Apr 17 10:38:31 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:38:31 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:38:31 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:38:31 user nova-compute[82522]:       <entry name="serial">1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab</entry>
Apr 17 10:38:31 user nova-compute[82522]:       <entry name="uuid">1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab</entry>
Apr 17 10:38:31 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:38:31 user nova-compute[82522]:     </system>
Apr 17 10:38:31 user nova-compute[82522]:   </sysinfo>
Apr 17 10:38:31 user nova-compute[82522]:   <os>
Apr 17 10:38:31 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:38:31 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:38:31 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:38:31 user nova-compute[82522]:   </os>
Apr 17 10:38:31 user nova-compute[82522]:   <features>
Apr 17 10:38:31 user nova-compute[82522]:     <acpi/>
Apr 17 10:38:31 user nova-compute[82522]:     <apic/>
Apr 17 10:38:31 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:38:31 user nova-compute[82522]:   </features>
Apr 17 10:38:31 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:38:31 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:38:31 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:38:31 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:38:31 user nova-compute[82522]:   </clock>
Apr 17 10:38:31 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:38:31 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:38:31 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:38:31 user nova-compute[82522]:   </cpu>
Apr 17 10:38:31 user nova-compute[82522]:   <devices>
Apr 17 10:38:31 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:38:31 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:38:31 user nova-compute[82522]:       <source dev="/dev/sdb"/>
Apr 17 10:38:31 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:38:31 user nova-compute[82522]:       <serial>263e05e5-5c44-4a01-bf88-51f9038d2169</serial>
Apr 17 10:38:31 user nova-compute[82522]:     </disk>
Apr 17 10:38:31 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:38:31 user nova-compute[82522]:       <mac address="fa:16:3e:c8:ce:9e"/>
Apr 17 10:38:31 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:31 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:38:31 user nova-compute[82522]:       <target dev="tap2acfe658-2d"/>
Apr 17 10:38:31 user nova-compute[82522]:     </interface>
Apr 17 10:38:31 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:38:31 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/console.log" append="off"/>
Apr 17 10:38:31 user nova-compute[82522]:     </serial>
Apr 17 10:38:31 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:38:31 user nova-compute[82522]:     <video>
Apr 17 10:38:31 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:31 user nova-compute[82522]:     </video>
Apr 17 10:38:31 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:38:31 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:38:31 user nova-compute[82522]:     </rng>
Apr 17 10:38:31 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:38:31 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:38:31 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:38:31 user nova-compute[82522]:     </memballoon>
Apr 17 10:38:31 user nova-compute[82522]:   </devices>
Apr 17 10:38:31 user nova-compute[82522]: </domain>
Apr 17 10:38:31 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1770450591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1770450591',id=13,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-zpux0ozq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:38:19Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ce:9e,bridge_name='br-int',has_traffic_filtering=True,id=2acfe658-2dce-4086-b24a-ef0b4c3714f8,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2acfe658-2d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG os_vif [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ce:9e,bridge_name='br-int',has_traffic_filtering=True,id=2acfe658-2dce-4086-b24a-ef0b4c3714f8,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2acfe658-2d') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2acfe658-2d, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2acfe658-2d, col_values=(('external_ids', {'iface-id': '2acfe658-2dce-4086-b24a-ef0b4c3714f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:ce:9e', 'vm-uuid': '1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:31 user nova-compute[82522]: INFO os_vif [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ce:9e,bridge_name='br-int',has_traffic_filtering=True,id=2acfe658-2dce-4086-b24a-ef0b4c3714f8,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2acfe658-2d')
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No VIF found with MAC fa:16:3e:c8:ce:9e, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquired lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'info_cache' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:38:32 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.policy [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f69d4d16a4bc479ba2a8a80f359135f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33eedb851ee244768016f5bf203d2f9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.objects.instance [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'flavor' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:38:32 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Creating image(s)
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "/opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "/opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "/opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:32 user nova-compute[82522]: INFO nova.compute.manager [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Attaching volume bdf94f31-0fa3-4682-abb5-161b0e318367 to /dev/vdb
Apr 17 10:38:32 user nova-compute[82522]: DEBUG os_brick.utils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.161s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[67617ecf-bf10-41e3-8b38-6b12b64c9c14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk 1073741824" returned: 0 in 0.059s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[67151927-58be-4513-a0e7-6e850d20a39d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deecc61-b0f6-467b-9200-c51b60aa4a12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c58d255-35db-4c22-b6c7-c19e9ff0dc50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:38:32 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c48af30-5283-4bcf-b5d0-19e3f9aaa054]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG os_brick.utils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating existing volume attachment record: 7ce0339d-7154-4e87-82bd-71b08b8084b8 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:32 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Cannot resize image /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'migration_context' on Instance uuid 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Ensure instance console log exists: /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updating instance_info_cache with network_info: [{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Releasing lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:33 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance destroyed successfully.
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'resources' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-92438997',display_name='tempest-AttachVolumeTestJSON-server-92438997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-92438997',id=3,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw==',key_name='tempest-keypair-1429660859',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-ip2vpwam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=59fd26de-d46e-4f41-91f6-090005a07d99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_vif [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7124043d-66, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:33 user nova-compute[82522]: INFO os_vif [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66')
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXJauTtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:33 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b3068-8e6a-4e53-ad27-f7e375d35574]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:38:33 user nova-compute[82522]: No targets found.
Apr 17 10:38:33 user nova-compute[82522]: iSNS:
Apr 17 10:38:33 user nova-compute[82522]: No targets found.
Apr 17 10:38:33 user nova-compute[82522]: STATIC:
Apr 17 10:38:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:38:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:38:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:38:33 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:38:33 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:38:33 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:38:33 user nova-compute[82522]: FIRMWARE:
Apr 17 10:38:33 user nova-compute[82522]: No targets found.
Apr 17 10:38:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:38:33 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:38:33 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad43cc8a-f256-4c66-b7bd-b741c06f497d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafbffbd-088e-4879-b18f-6af5503a0bed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:33 user nova-compute[82522]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:33 user nova-compute[82522]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2846c9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1'): ({'sdj'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Removing single pathed devices sdj {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf71a971-b837-4df7-8d5a-a81b03e04196]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae3df06-df28-4f46-9f1c-e1d83375a1c3]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flushing IO for device /dev/sdj {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[69027f35-fb27-4baa-9054-770579f1542a]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Successfully created port: e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.034s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e147c-f6cd-4dd8-a931-efab2b0db072]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] SCSI volumes sdj have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:33 user nova-compute[82522]: WARNING nova.compute.manager [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state building and task_state spawning.
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b3a48f-3b65-4b9c-a92b-1aff76dd98ba]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b5995e-cfd8-4a68-9a0b-1390536c0c12]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260]
Apr 17 10:38:33 user nova-compute[82522]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260] successful.
Apr 17 10:38:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8ef637-24f0-486a-b96b-c58a5f8fe67e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== disconnect_volume: return (374ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Start _get_guest_xml network_info=[{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '8b9fd253-6e8c-4a2f-8b96-20096969af9e', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXJauTtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '59fd26de-d46e-4f41-91f6-090005a07d99', 'attached_at': '', 'detached_at': '', 'volume_id': '77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 'serial': '77166f39-c9b1-499f-9ed8-1fdd6a0d81a1'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'numa_topology' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'vcpu_model' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXJauTtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:33 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:33 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:33 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcfdd0c-92ac-4f1b-994c-59d553b8bd0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:38:33 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a28a92-7efb-44af-ac45-05cf6f199826]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1] added
Apr 17 10:38:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb28b13-0bb1-4628-be4f-850881368633]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbb1b79-c5f2-4057-b10f-d9b84b8739cc]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXJauTtP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXJauTtP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb4c1c-33f2-4d32-8576-21e16597431d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VXJauTtP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fae0fe2-8fb0-4d28-886b-4d093a7d6da8]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c597ac4-4632-4391-b9fd-1273b0c95a52]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3e7a03-bc85-4901-b791-eb9dabbf7d63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681727899.0732837, b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:34 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] VM Stopped (Lifecycle Event)
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260]
Apr 17 10:38:34 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260] successful.
Apr 17 10:38:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.compute.manager [None req-282e7b36-69f1-4ec8-99e9-ba068b5bc3fa None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf24faf8-9dca-4217-9e75-e83e79c203a0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9063acb5-f06b-49ce-ad58-86073e7018ea]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:34 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:34 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9d2242-b8a6-4550-8554-1197aa41ee56]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXJauTtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Successfully updated port: e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "refresh_cache-89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquired lock "refresh_cache-89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received event network-changed-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Refreshing instance network info cache due to event network-changed-e66863ce-1b10-4701-9a7c-3940117a0237. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] Acquiring lock "refresh_cache-89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'pci_requests' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'numa_topology' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:38:34 user nova-compute[82522]: INFO nova.compute.claims [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Claim successful on node user
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Updating instance_info_cache with network_info: [{"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Releasing lock "refresh_cache-89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Instance network_info: |[{"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] Acquired lock "refresh_cache-89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.network.neutron [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Refreshing network info cache for port e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Start _get_guest_xml network_info=[{"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:38:34 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:34 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1787327953',display_name='tempest-VolumesAdminNegativeTest-server-1787327953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1787327953',id=14,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnn0G8T/NqKd4pdI8CnZBIrfuGV0OGYhlLKbelX5jBuYIOxA1KkpZDA2TZvP5aUxJYkJ3etLyosOZOXzhagUGOxEpiTev/9WWYjYrPv7DYs6AD3kMjO6NHdWKptKjHhkQ==',key_name='tempest-keypair-1894950384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33eedb851ee244768016f5bf203d2f9f',ramdisk_id='',reservation_id='r-alaieves',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1835927457',owner_user_name='tempest-VolumesAdminNegativeTest-1835927457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f69d4d16a4bc479ba2a8a80f359135f7',uuid=89bbf0b5-0314-4bc5-ba97-feae5a5a49bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converting VIF {"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1a:44,bridge_name='br-int',has_traffic_filtering=True,id=e66863ce-1b10-4701-9a7c-3940117a0237,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66863ce-1b') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'pci_devices' on Instance uuid 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:38:34 user nova-compute[82522]:   <uuid>89bbf0b5-0314-4bc5-ba97-feae5a5a49bf</uuid>
Apr 17 10:38:34 user nova-compute[82522]:   <name>instance-0000000e</name>
Apr 17 10:38:34 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:38:34 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:38:34 user nova-compute[82522]:   <metadata>
Apr 17 10:38:34 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:38:34 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:38:34 user nova-compute[82522]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1787327953</nova:name>
Apr 17 10:38:34 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:38:34</nova:creationTime>
Apr 17 10:38:34 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:38:34 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:38:34 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:38:34 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:38:34 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:38:34 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:38:34 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:38:34 user nova-compute[82522]:       <nova:owner>
Apr 17 10:38:34 user nova-compute[82522]:         <nova:user uuid="f69d4d16a4bc479ba2a8a80f359135f7">tempest-VolumesAdminNegativeTest-1835927457-project-member</nova:user>
Apr 17 10:38:34 user nova-compute[82522]:         <nova:project uuid="33eedb851ee244768016f5bf203d2f9f">tempest-VolumesAdminNegativeTest-1835927457</nova:project>
Apr 17 10:38:34 user nova-compute[82522]:       </nova:owner>
Apr 17 10:38:34 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:38:34 user nova-compute[82522]:       <nova:ports>
Apr 17 10:38:34 user nova-compute[82522]:         <nova:port uuid="e66863ce-1b10-4701-9a7c-3940117a0237">
Apr 17 10:38:34 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 10:38:34 user nova-compute[82522]:         </nova:port>
Apr 17 10:38:34 user nova-compute[82522]:       </nova:ports>
Apr 17 10:38:34 user nova-compute[82522]:     </nova:instance>
Apr 17 10:38:34 user nova-compute[82522]:   </metadata>
Apr 17 10:38:34 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:38:34 user nova-compute[82522]:     <system>
Apr 17 10:38:34 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:38:34 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:38:34 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:38:34 user nova-compute[82522]:       <entry name="serial">89bbf0b5-0314-4bc5-ba97-feae5a5a49bf</entry>
Apr 17 10:38:34 user nova-compute[82522]:       <entry name="uuid">89bbf0b5-0314-4bc5-ba97-feae5a5a49bf</entry>
Apr 17 10:38:34 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:38:34 user nova-compute[82522]:     </system>
Apr 17 10:38:34 user nova-compute[82522]:   </sysinfo>
Apr 17 10:38:34 user nova-compute[82522]:   <os>
Apr 17 10:38:34 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:38:34 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:38:34 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:38:34 user nova-compute[82522]:   </os>
Apr 17 10:38:34 user nova-compute[82522]:   <features>
Apr 17 10:38:34 user nova-compute[82522]:     <acpi/>
Apr 17 10:38:34 user nova-compute[82522]:     <apic/>
Apr 17 10:38:34 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:38:34 user nova-compute[82522]:   </features>
Apr 17 10:38:34 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:38:34 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:38:34 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:38:34 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:38:34 user nova-compute[82522]:   </clock>
Apr 17 10:38:34 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:38:34 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:38:34 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:38:34 user nova-compute[82522]:   </cpu>
Apr 17 10:38:34 user nova-compute[82522]:   <devices>
Apr 17 10:38:34 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:38:34 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:38:34 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk"/>
Apr 17 10:38:34 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:38:34 user nova-compute[82522]:     </disk>
Apr 17 10:38:34 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:38:34 user nova-compute[82522]:       <mac address="fa:16:3e:ba:1a:44"/>
Apr 17 10:38:34 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:34 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:38:34 user nova-compute[82522]:       <target dev="tape66863ce-1b"/>
Apr 17 10:38:34 user nova-compute[82522]:     </interface>
Apr 17 10:38:34 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:38:34 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/console.log" append="off"/>
Apr 17 10:38:34 user nova-compute[82522]:     </serial>
Apr 17 10:38:34 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:38:34 user nova-compute[82522]:     <video>
Apr 17 10:38:34 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:34 user nova-compute[82522]:     </video>
Apr 17 10:38:34 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:38:34 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:38:34 user nova-compute[82522]:     </rng>
Apr 17 10:38:34 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:38:34 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:38:34 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:38:34 user nova-compute[82522]:     </memballoon>
Apr 17 10:38:34 user nova-compute[82522]:   </devices>
Apr 17 10:38:34 user nova-compute[82522]: </domain>
Apr 17 10:38:34 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1787327953',display_name='tempest-VolumesAdminNegativeTest-server-1787327953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1787327953',id=14,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnn0G8T/NqKd4pdI8CnZBIrfuGV0OGYhlLKbelX5jBuYIOxA1KkpZDA2TZvP5aUxJYkJ3etLyosOZOXzhagUGOxEpiTev/9WWYjYrPv7DYs6AD3kMjO6NHdWKptKjHhkQ==',key_name='tempest-keypair-1894950384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33eedb851ee244768016f5bf203d2f9f',ramdisk_id='',reservation_id='r-alaieves',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1835927457',owner_user_name='tempest-VolumesAdminNegativeTest-1835927457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f69d4d16a4bc479ba2a8a80f359135f7',uuid=89bbf0b5-0314-4bc5-ba97-feae5a5a49bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converting VIF {"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1a:44,bridge_name='br-int',has_traffic_filtering=True,id=e66863ce-1b10-4701-9a7c-3940117a0237,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66863ce-1b') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG os_vif [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1a:44,bridge_name='br-int',has_traffic_filtering=True,id=e66863ce-1b10-4701-9a7c-3940117a0237,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66863ce-1b') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape66863ce-1b, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape66863ce-1b, col_values=(('external_ids', {'iface-id': 'e66863ce-1b10-4701-9a7c-3940117a0237', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:1a:44', 'vm-uuid': '89bbf0b5-0314-4bc5-ba97-feae5a5a49bf'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:35 user nova-compute[82522]: INFO os_vif [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1a:44,bridge_name='br-int',has_traffic_filtering=True,id=e66863ce-1b10-4701-9a7c-3940117a0237,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66863ce-1b')
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] No VIF found with MAC fa:16:3e:ba:1a:44, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:38:35 user nova-compute[82522]: INFO nova.network.neutron [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updating port cd279a0c-99eb-4e32-876e-6d2208cc1db2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23366396637366437', 'path': '/dev/sdc'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366396637366437', 'path': '/dev/sdc'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-92438997',display_name='tempest-AttachVolumeTestJSON-server-92438997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-92438997',id=3,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw==',key_name='tempest-keypair-1429660859',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-ip2vpwam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=59fd26de-d46e-4f41-91f6-090005a07d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'pci_devices' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:38:35 user nova-compute[82522]:   <uuid>59fd26de-d46e-4f41-91f6-090005a07d99</uuid>
Apr 17 10:38:35 user nova-compute[82522]:   <name>instance-00000003</name>
Apr 17 10:38:35 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:38:35 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:38:35 user nova-compute[82522]:   <metadata>
Apr 17 10:38:35 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:38:35 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:38:35 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeTestJSON-server-92438997</nova:name>
Apr 17 10:38:35 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:38:33</nova:creationTime>
Apr 17 10:38:35 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:38:35 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:38:35 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:38:35 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:38:35 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:38:35 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:38:35 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:38:35 user nova-compute[82522]:       <nova:owner>
Apr 17 10:38:35 user nova-compute[82522]:         <nova:user uuid="a9862432f87f4500a46f32a0b27d54d4">tempest-AttachVolumeTestJSON-2096000567-project-member</nova:user>
Apr 17 10:38:35 user nova-compute[82522]:         <nova:project uuid="6a17ec3e1b314acbb701f2d2d27d0560">tempest-AttachVolumeTestJSON-2096000567</nova:project>
Apr 17 10:38:35 user nova-compute[82522]:       </nova:owner>
Apr 17 10:38:35 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:38:35 user nova-compute[82522]:       <nova:ports>
Apr 17 10:38:35 user nova-compute[82522]:         <nova:port uuid="7124043d-665c-4a42-a041-b91ccc237b63">
Apr 17 10:38:35 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:38:35 user nova-compute[82522]:         </nova:port>
Apr 17 10:38:35 user nova-compute[82522]:       </nova:ports>
Apr 17 10:38:35 user nova-compute[82522]:     </nova:instance>
Apr 17 10:38:35 user nova-compute[82522]:   </metadata>
Apr 17 10:38:35 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:38:35 user nova-compute[82522]:     <system>
Apr 17 10:38:35 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:38:35 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:38:35 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:38:35 user nova-compute[82522]:       <entry name="serial">59fd26de-d46e-4f41-91f6-090005a07d99</entry>
Apr 17 10:38:35 user nova-compute[82522]:       <entry name="uuid">59fd26de-d46e-4f41-91f6-090005a07d99</entry>
Apr 17 10:38:35 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:38:35 user nova-compute[82522]:     </system>
Apr 17 10:38:35 user nova-compute[82522]:   </sysinfo>
Apr 17 10:38:35 user nova-compute[82522]:   <os>
Apr 17 10:38:35 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:38:35 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:38:35 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:38:35 user nova-compute[82522]:   </os>
Apr 17 10:38:35 user nova-compute[82522]:   <features>
Apr 17 10:38:35 user nova-compute[82522]:     <acpi/>
Apr 17 10:38:35 user nova-compute[82522]:     <apic/>
Apr 17 10:38:35 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:38:35 user nova-compute[82522]:   </features>
Apr 17 10:38:35 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:38:35 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:38:35 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:38:35 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:38:35 user nova-compute[82522]:   </clock>
Apr 17 10:38:35 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:38:35 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:38:35 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:38:35 user nova-compute[82522]:   </cpu>
Apr 17 10:38:35 user nova-compute[82522]:   <devices>
Apr 17 10:38:35 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:38:35 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:38:35 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk"/>
Apr 17 10:38:35 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:38:35 user nova-compute[82522]:     </disk>
Apr 17 10:38:35 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:38:35 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:38:35 user nova-compute[82522]:       <source dev="/dev/sdc"/>
Apr 17 10:38:35 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:38:35 user nova-compute[82522]:       <serial>77166f39-c9b1-499f-9ed8-1fdd6a0d81a1</serial>
Apr 17 10:38:35 user nova-compute[82522]:     </disk>
Apr 17 10:38:35 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:38:35 user nova-compute[82522]:       <mac address="fa:16:3e:7f:75:70"/>
Apr 17 10:38:35 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:35 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:38:35 user nova-compute[82522]:       <target dev="tap7124043d-66"/>
Apr 17 10:38:35 user nova-compute[82522]:     </interface>
Apr 17 10:38:35 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:38:35 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/console.log" append="off"/>
Apr 17 10:38:35 user nova-compute[82522]:     </serial>
Apr 17 10:38:35 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:38:35 user nova-compute[82522]:     <video>
Apr 17 10:38:35 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:35 user nova-compute[82522]:     </video>
Apr 17 10:38:35 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:38:35 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:38:35 user nova-compute[82522]:     </rng>
Apr 17 10:38:35 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:38:35 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:38:35 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:38:35 user nova-compute[82522]:     </memballoon>
Apr 17 10:38:35 user nova-compute[82522]:   </devices>
Apr 17 10:38:35 user nova-compute[82522]: </domain>
Apr 17 10:38:35 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681727900.2577097, 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:35 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] VM Stopped (Lifecycle Event)
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-21c68801-01eb-4a53-965a-a9ca410e0e67 None None] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'trusted_certs' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727915.6074011, 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:35 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] VM Resumed (Lifecycle Event)
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:35 user nova-compute[82522]: WARNING nova.compute.manager [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state building and task_state spawning.
Apr 17 10:38:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Instance spawned successfully.
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:35 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727915.6096418, 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:35 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] VM Started (Lifecycle Event)
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.156s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:35 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.network.neutron [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Updated VIF entry in instance network info cache for port e66863ce-1b10-4701-9a7c-3940117a0237. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.network.neutron [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Updating instance_info_cache with network_info: [{"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:35 user nova-compute[82522]: INFO nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Took 5.68 seconds to spawn the instance on the hypervisor.
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] Releasing lock "refresh_cache-89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Cannot resize image /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'migration_context' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-92438997',display_name='tempest-AttachVolumeTestJSON-server-92438997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-92438997',id=3,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw==',key_name='tempest-keypair-1429660859',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-ip2vpwam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=59fd26de-d46e-4f41-91f6-090005a07d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG os_vif [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7124043d-66, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7124043d-66, col_values=(('external_ids', {'iface-id': '7124043d-665c-4a42-a041-b91ccc237b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:75:70', 'vm-uuid': '59fd26de-d46e-4f41-91f6-090005a07d99'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:35 user nova-compute[82522]: INFO nova.compute.manager [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Took 17.33 seconds to build instance.
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.431s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:36 user nova-compute[82522]: INFO os_vif [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66')
Apr 17 10:38:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquired lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-changed-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Refreshing instance network info cache due to event network-changed-cd279a0c-99eb-4e32-876e-6d2208cc1db2. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] Acquiring lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updating instance_info_cache with network_info: [{"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Releasing lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:38:36 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Creating image(s)
Apr 17 10:38:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:36 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'trusted_certs' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] Acquired lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Refreshing network info cache for port cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:38:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "67b0db3dbe0a00c281659fa21006f6da5d073fbd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "67b0db3dbe0a00c281659fa21006f6da5d073fbd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received event network-vif-plugged-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] No waiting events found dispatching network-vif-plugged-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:38 user nova-compute[82522]: WARNING nova.compute.manager [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received unexpected event network-vif-plugged-e66863ce-1b10-4701-9a7c-3940117a0237 for instance with vm_state building and task_state spawning.
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd.part --force-share --output=json" returned: 0 in 0.162s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG nova.virt.images [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 41ee7e1e-9d03-4b1f-8337-75bdcd458d85 was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd.part /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd.part /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd.converted" returned: 0 in 0.391s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "67b0db3dbe0a00c281659fa21006f6da5d073fbd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.857s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updated VIF entry in instance network info cache for port cd279a0c-99eb-4e32-876e-6d2208cc1db2. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updating instance_info_cache with network_info: [{"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] Releasing lock "refresh_cache-c4315753-415c-45cd-b06f-da1e3ccc6e4d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd --force-share --output=json" returned: 0 in 0.184s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "67b0db3dbe0a00c281659fa21006f6da5d073fbd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "67b0db3dbe0a00c281659fa21006f6da5d073fbd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:39 user nova-compute[82522]: WARNING nova.compute.manager [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state stopped and task_state powering-on.
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd --force-share --output=json" returned: 0 in 0.194s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd,backing_fmt=raw /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd,backing_fmt=raw /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk 1073741824" returned: 0 in 0.066s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "67b0db3dbe0a00c281659fa21006f6da5d073fbd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'migration_context' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:39 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Rebasing disk image.
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaVRPKep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:39 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:39 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:39 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:38:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.171s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 -F raw /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d3d85c-a730-4d48-bcee-a3df7bb62fef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:38:39 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[088bb7e2-1684-40c0-ad1f-d409d9e7c98e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367] added
Apr 17 10:38:39 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received event network-vif-plugged-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] No waiting events found dispatching network-vif-plugged-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:39 user nova-compute[82522]: WARNING nova.compute.manager [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received unexpected event network-vif-plugged-e66863ce-1b10-4701-9a7c-3940117a0237 for instance with vm_state building and task_state spawning.
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c5546-9d79-495e-9c01-f5039e866164]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3a4711-db76-4c06-8e3d-c1aa096ce9dc]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaVRPKep {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaVRPKep" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba78187-0844-4bf8-9467-676201340807]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xaVRPKep'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f0e1d-4e33-4083-b902-11e2daa1932a]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbba38e9-31d7-40cc-bc77-b8da54a069a6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:39 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:39 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:39 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:39 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afacfdd-651b-47e0-8705-66a2be8f1650]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367, portal: 172.16.0.220,3260]
Apr 17 10:38:40 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367, portal: 172.16.0.220,3260] successful.
Apr 17 10:38:40 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5172d0-c75e-4f67-bb8c-2eb1a23dfd72]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[661d0d51-5c21-4da2-a824-9b120a54afaf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:40 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:40 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:40 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:40 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:40 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:40 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce9433a-d674-485f-85b1-3917d97d3f9f]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:38:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaVRPKep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23664636438343461', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664636438343461', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.objects.instance [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'flavor' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.objects.instance [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:38:41 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:38:41 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:38:41 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:38:41 user nova-compute[82522]:   <serial>bdf94f31-0fa3-4682-abb5-161b0e318367</serial>
Apr 17 10:38:41 user nova-compute[82522]: </disk>
Apr 17 10:38:41 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:41 user nova-compute[82522]: WARNING nova.compute.manager [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state stopped and task_state powering-on.
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:41 user nova-compute[82522]: INFO nova.compute.manager [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attaching volume 74dc9a66-6730-41d3-95e1-920360e21cb9 to /dev/vdb
Apr 17 10:38:41 user nova-compute[82522]: DEBUG os_brick.utils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727921.5448258, 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] VM Resumed (Lifecycle Event)
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f9bd3-c104-43c1-b978-bee22c53dd54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance rebooted successfully.
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Instance spawned successfully.
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.039s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9631cded-3d80-455e-bc23-5a9174d0a7bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[68836114-8749-4284-818d-e0358193c719]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[340b8edc-003c-4ca7-a6c2-7e66ac2f2ecb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:38:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727921.5454478, 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] VM Started (Lifecycle Event)
Apr 17 10:38:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:38:41 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:38:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe62ed2-1e62-4aba-b159-8089395c19a5]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG os_brick.utils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== get_connector_properties: return (362ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating existing volume attachment record: c35c8de5-80ce-46b3-9318-6285e843c0d5 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:38:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727921.5558736, 59fd26de-d46e-4f41-91f6-090005a07d99 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] VM Resumed (Lifecycle Event)
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] No VIF found with MAC fa:16:3e:59:c9:94, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:42 user nova-compute[82522]: INFO nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Took 9.81 seconds to spawn the instance on the hypervisor.
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727921.5562823, 59fd26de-d46e-4f41-91f6-090005a07d99 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] VM Started (Lifecycle Event)
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:42 user nova-compute[82522]: INFO nova.compute.manager [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Took 10.97 seconds to build instance.
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.088s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 -F raw /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk" returned: 0 in 2.817s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Ensure instance console log exists: /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Start _get_guest_xml network_info=[{"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='01e577b99f8f092c45ddc45cb48169fb',container_format='bare',created_at=2023-04-17T10:36:36Z,direct_url=<?>,disk_format='qcow2',id=41ee7e1e-9d03-4b1f-8337-75bdcd458d85,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-146173286-shelved',owner='e6dac880f4294283ae7838bfa0edf5c1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-17T10:36:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'caf61358-f70e-4f40-af64-8b4dd020bb0b', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUvdFypT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'c4315753-415c-45cd-b06f-da1e3ccc6e4d', 'attached_at': '', 'detached_at': '', 'volume_id': '1e959d4f-1d94-402d-84d5-323e6a987d67', 'serial': '1e959d4f-1d94-402d-84d5-323e6a987d67'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.978s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:42 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:42 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='01e577b99f8f092c45ddc45cb48169fb',container_format='bare',created_at=2023-04-17T10:36:36Z,direct_url=<?>,disk_format='qcow2',id=41ee7e1e-9d03-4b1f-8337-75bdcd458d85,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-146173286-shelved',owner='e6dac880f4294283ae7838bfa0edf5c1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-17T10:36:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUvdFypT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:42 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:42 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:42 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c66514-139f-464b-b62f-d0db88173b21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:38:42 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e60a42b-5cb2-4d42-9e37-262f5435f423]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67] added
Apr 17 10:38:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f8d3c3-aaa2-434e-a2cd-13317866e466]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cc7fea-a33d-4309-a730-b1c7fd8fac30]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUvdFypT {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUvdFypT" returned: 0 in 0.035s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ff878-fc08-4439-a887-35fd883ffb4e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iUvdFypT'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8434c8-6c26-42c7-8068-20d904b833be]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[650c955f-dd53-48c3-a939-afad7178ff11]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faff70a-aef5-4a8b-88ee-3921b1484d00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67, portal: 172.16.0.220,3260]
Apr 17 10:38:42 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67, portal: 172.16.0.220,3260] successful.
Apr 17 10:38:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffb2bf4-5b5a-4302-8446-92df8dc8d1ca]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d3209e-aabd-432d-bd3d-8f7f14137a19]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:38:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.037s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[532da135-3f6a-47ab-b624-29a70dbefb39]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:43 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:38:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:44 user nova-compute[82522]: INFO nova.compute.manager [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Rescuing
Apr 17 10:38:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquired lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUvdFypT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26631333866653534', 'path': '/dev/sde'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631333866653534', 'path': '/dev/sde'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-146173286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-146173286',id=4,image_ref='41ee7e1e-9d03-4b1f-8337-75bdcd458d85',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-850060525',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-llggnnwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member',shelved_at='2023-04-17T10:36:41.562825',shelved_host='user',shelved_image_id='41ee7e1e-9d03-4b1f-8337-75bdcd458d85'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=c4315753-415c-45cd-b06f-da1e3ccc6e4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'pci_devices' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:38:44 user nova-compute[82522]:   <uuid>c4315753-415c-45cd-b06f-da1e3ccc6e4d</uuid>
Apr 17 10:38:44 user nova-compute[82522]:   <name>instance-00000004</name>
Apr 17 10:38:44 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:38:44 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:38:44 user nova-compute[82522]:   <metadata>
Apr 17 10:38:44 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:38:44 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:38:44 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-146173286</nova:name>
Apr 17 10:38:44 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:38:42</nova:creationTime>
Apr 17 10:38:44 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:38:44 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:38:44 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:38:44 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:38:44 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:38:44 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:38:44 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:38:44 user nova-compute[82522]:       <nova:owner>
Apr 17 10:38:44 user nova-compute[82522]:         <nova:user uuid="aea97828312f45ffa1b7148c375a7f9a">tempest-AttachVolumeShelveTestJSON-1174346715-project-member</nova:user>
Apr 17 10:38:44 user nova-compute[82522]:         <nova:project uuid="e6dac880f4294283ae7838bfa0edf5c1">tempest-AttachVolumeShelveTestJSON-1174346715</nova:project>
Apr 17 10:38:44 user nova-compute[82522]:       </nova:owner>
Apr 17 10:38:44 user nova-compute[82522]:       <nova:root type="image" uuid="41ee7e1e-9d03-4b1f-8337-75bdcd458d85"/>
Apr 17 10:38:44 user nova-compute[82522]:       <nova:ports>
Apr 17 10:38:44 user nova-compute[82522]:         <nova:port uuid="cd279a0c-99eb-4e32-876e-6d2208cc1db2">
Apr 17 10:38:44 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:38:44 user nova-compute[82522]:         </nova:port>
Apr 17 10:38:44 user nova-compute[82522]:       </nova:ports>
Apr 17 10:38:44 user nova-compute[82522]:     </nova:instance>
Apr 17 10:38:44 user nova-compute[82522]:   </metadata>
Apr 17 10:38:44 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:38:44 user nova-compute[82522]:     <system>
Apr 17 10:38:44 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:38:44 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:38:44 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:38:44 user nova-compute[82522]:       <entry name="serial">c4315753-415c-45cd-b06f-da1e3ccc6e4d</entry>
Apr 17 10:38:44 user nova-compute[82522]:       <entry name="uuid">c4315753-415c-45cd-b06f-da1e3ccc6e4d</entry>
Apr 17 10:38:44 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:38:44 user nova-compute[82522]:     </system>
Apr 17 10:38:44 user nova-compute[82522]:   </sysinfo>
Apr 17 10:38:44 user nova-compute[82522]:   <os>
Apr 17 10:38:44 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:38:44 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:38:44 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:38:44 user nova-compute[82522]:   </os>
Apr 17 10:38:44 user nova-compute[82522]:   <features>
Apr 17 10:38:44 user nova-compute[82522]:     <acpi/>
Apr 17 10:38:44 user nova-compute[82522]:     <apic/>
Apr 17 10:38:44 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:38:44 user nova-compute[82522]:   </features>
Apr 17 10:38:44 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:38:44 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:38:44 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:38:44 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:38:44 user nova-compute[82522]:   </clock>
Apr 17 10:38:44 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:38:44 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:38:44 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:38:44 user nova-compute[82522]:   </cpu>
Apr 17 10:38:44 user nova-compute[82522]:   <devices>
Apr 17 10:38:44 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:38:44 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:38:44 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk"/>
Apr 17 10:38:44 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:38:44 user nova-compute[82522]:     </disk>
Apr 17 10:38:44 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:38:44 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:38:44 user nova-compute[82522]:       <source dev="/dev/sde"/>
Apr 17 10:38:44 user nova-compute[82522]:       <target dev="vdc" bus="virtio"/>
Apr 17 10:38:44 user nova-compute[82522]:       <serial>1e959d4f-1d94-402d-84d5-323e6a987d67</serial>
Apr 17 10:38:44 user nova-compute[82522]:     </disk>
Apr 17 10:38:44 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:38:44 user nova-compute[82522]:       <mac address="fa:16:3e:74:83:7c"/>
Apr 17 10:38:44 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:44 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:38:44 user nova-compute[82522]:       <target dev="tapcd279a0c-99"/>
Apr 17 10:38:44 user nova-compute[82522]:     </interface>
Apr 17 10:38:44 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:38:44 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/console.log" append="off"/>
Apr 17 10:38:44 user nova-compute[82522]:     </serial>
Apr 17 10:38:44 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:38:44 user nova-compute[82522]:     <video>
Apr 17 10:38:44 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:44 user nova-compute[82522]:     </video>
Apr 17 10:38:44 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:38:44 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:38:44 user nova-compute[82522]:     </rng>
Apr 17 10:38:44 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:38:44 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:38:44 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:38:44 user nova-compute[82522]:     </memballoon>
Apr 17 10:38:44 user nova-compute[82522]:   </devices>
Apr 17 10:38:44 user nova-compute[82522]: </domain>
Apr 17 10:38:44 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-146173286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-146173286',id=4,image_ref='41ee7e1e-9d03-4b1f-8337-75bdcd458d85',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-850060525',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-llggnnwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member',shelved_at='2023-04-17T10:36:41.562825',shelved_host='user',shelved_image_id='41ee7e1e-9d03-4b1f-8337-75bdcd458d85'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=c4315753-415c-45cd-b06f-da1e3ccc6e4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG os_vif [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd279a0c-99, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd279a0c-99, col_values=(('external_ids', {'iface-id': 'cd279a0c-99eb-4e32-876e-6d2208cc1db2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:83:7c', 'vm-uuid': 'c4315753-415c-45cd-b06f-da1e3ccc6e4d'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:44 user nova-compute[82522]: INFO os_vif [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99')
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] No VIF found with MAC fa:16:3e:74:83:7c, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:38:45 user nova-compute[82522]: DEBUG nova.network.neutron [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:38:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Releasing lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:38:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] No waiting events found dispatching network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:46 user nova-compute[82522]: WARNING nova.compute.manager [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received unexpected event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 17 10:38:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:46 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Instance destroyed successfully.
Apr 17 10:38:46 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Attempting a stable device rescue
Apr 17 10:38:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=82522) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Instance directory exists: not creating {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 10:38:46 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Creating image(s)
Apr 17 10:38:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG nova.objects.instance [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'trusted_certs' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "efaccf0df7ddc7bd6383cf333477ac17303729d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "efaccf0df7ddc7bd6383cf333477ac17303729d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:38:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYoZGUCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:47 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:47 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:47 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:38:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20cdb88-8521-4d58-8aca-d955bbd5216c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:38:48 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4705e7-9b13-4030-b7c0-fab9024c49b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9] added
Apr 17 10:38:48 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7013ae77-8a58-4014-8f94-fa9e6f365cf9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a74b8c-4e41-4833-95af-91606869fa07]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYoZGUCJ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYoZGUCJ" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51ea94f-6e50-4425-b73b-2e6bb5778b9d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aYoZGUCJ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3.part --force-share --output=json" returned: 0 in 0.249s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG nova.virt.images [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 1d484d43-a1db-4806-ae9e-7be2347dbfec was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3.part /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df20200-6fff-42d6-89ec-caf2d016d6e7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2b9e04-ff48-4fff-a90a-f81732f7b81e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] No waiting events found dispatching network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:48 user nova-compute[82522]: WARNING nova.compute.manager [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received unexpected event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 17 10:38:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:48 user nova-compute[82522]: WARNING nova.compute.manager [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state active and task_state rescuing.
Apr 17 10:38:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:48 user nova-compute[82522]: WARNING nova.compute.manager [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state active and task_state rescuing.
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.191s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[84165ddb-0834-45ef-a451-989431ad1581]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9, portal: 172.16.0.220,3260]
Apr 17 10:38:48 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9, portal: 172.16.0.220,3260] successful.
Apr 17 10:38:48 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3.part /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3.converted" returned: 0 in 0.387s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdafa4a9-9db9-41e2-ab65-17bec5b69f5c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[67037e14-3825-4a0e-918b-e62efbb3914c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 (non-flash)
Apr 17 10:38:48 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.696s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.041s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b634a-75b9-4277-b844-48607c9d65a3]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYoZGUCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "efaccf0df7ddc7bd6383cf333477ac17303729d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.870s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "efaccf0df7ddc7bd6383cf333477ac17303729d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "efaccf0df7ddc7bd6383cf333477ac17303729d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3 --force-share --output=json" returned: 0 in 0.198s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3,backing_fmt=raw /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3,backing_fmt=raw /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue" returned: 0 in 0.082s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "efaccf0df7ddc7bd6383cf333477ac17303729d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.objects.instance [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'migration_context' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Start _get_guest_xml network_info=[{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "vif_mac": "fa:16:3e:59:c9:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1d484d43-a1db-4806-ae9e-7be2347dbfec', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '7ce0339d-7154-4e87-82bd-71b08b8084b8', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaVRPKep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e0b1074e-7352-437a-b2ec-1eaefc5bf1b4', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdf94f31-0fa3-4682-abb5-161b0e318367', 'serial': 'bdf94f31-0fa3-4682-abb5-161b0e318367'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.objects.instance [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'resources' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.objects.instance [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'numa_topology' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:49 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:49 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.objects.instance [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'vcpu_model' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaVRPKep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:49 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727929.5272138, c4315753-415c-45cd-b06f-da1e3ccc6e4d => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:49 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] VM Resumed (Lifecycle Event)
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:38:49 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance spawned successfully.
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:49 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727929.5457077, c4315753-415c-45cd-b06f-da1e3ccc6e4d => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:49 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] VM Started (Lifecycle Event)
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:49 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.773s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== connect_volume: return (1775ms) {'type': 'block', 'scsi_wwn': '23736616630306633', 'path': '/dev/sdf'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736616630306633', 'path': '/dev/sdf'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.422s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:49 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:49 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.objects.instance [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260" returned: 0 in 0.036s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d7eddf-c0c8-4db4-96c4-652a83234179]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xaVRPKep\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 17 10:38:49 user nova-compute[82522]: node.name = iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:38:49 user nova-compute[82522]: node.tpgt = -1
Apr 17 10:38:49 user nova-compute[82522]: node.startup = automatic
Apr 17 10:38:49 user nova-compute[82522]: node.leading_login = No
Apr 17 10:38:49 user nova-compute[82522]: iface.iscsi_ifacename = default
Apr 17 10:38:49 user nova-compute[82522]: iface.net_ifacename = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.ipaddress = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.prefix_len = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.hwaddress = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.transport_name = tcp
Apr 17 10:38:49 user nova-compute[82522]: iface.initiatorname = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.state = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.vlan_id = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.vlan_priority = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.vlan_state = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.iface_num = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.mtu = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.port = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.bootproto = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.subnet_mask = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.gateway = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.dhcp_alt_client_id_state = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.dhcp_alt_client_id = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.dhcp_dns = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.dhcp_learn_iqn = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.dhcp_req_vendor_id_state = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.dhcp_vendor_id_state = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.dhcp_vendor_id = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.dhcp_slp_da = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.fragmentation = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.gratuitous_arp = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.incoming_forwarding = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.tos_state = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.tos = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.ttl = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.delayed_ack = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.tcp_nagle = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.tcp_wsf_state = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.tcp_wsf = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.tcp_timer_scale = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.tcp_timestamp = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.redirect = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.def_task_mgmt_timeout = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.header_digest = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.data_digest = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.immediate_data = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.initial_r2t = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.data_seq_inorder = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.data_pdu_inorder = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.erl = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.max_receive_data_len = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.first_burst_len = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.max_outstanding_r2t = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.max_burst_len = 0
Apr 17 10:38:49 user nova-compute[82522]: iface.chap_auth = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.bidi_chap = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.strict_login_compliance = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.discovery_auth = <empty>
Apr 17 10:38:49 user nova-compute[82522]: iface.discovery_logout = <empty>
Apr 17 10:38:49 user nova-compute[82522]: node.discovery_address = <empty>
Apr 17 10:38:49 user nova-compute[82522]: node.discovery_port = 0
Apr 17 10:38:49 user nova-compute[82522]: node.discovery_type = static
Apr 17 10:38:49 user nova-compute[82522]: node.session.initial_cmdsn = 0
Apr 17 10:38:49 user nova-compute[82522]: node.session.initial_login_retry_max = 8
Apr 17 10:38:49 user nova-compute[82522]: node.session.xmit_thread_priority = -20
Apr 17 10:38:49 user nova-compute[82522]: node.session.cmds_max = 128
Apr 17 10:38:49 user nova-compute[82522]: node.session.queue_depth = 32
Apr 17 10:38:49 user nova-compute[82522]: node.session.nr_sessions = 1
Apr 17 10:38:49 user nova-compute[82522]: node.session.auth.authmethod = CHAP
Apr 17 10:38:49 user nova-compute[82522]: node.session.auth.username = xaVRPKep
Apr 17 10:38:49 user nova-compute[82522]: node.session.auth.password = ***
Apr 17 10:38:49 user nova-compute[82522]: node.session.auth.username_in = <empty>
Apr 17 10:38:49 user nova-compute[82522]: node.session.auth.password_in = <empty>
Apr 17 10:38:49 user nova-compute[82522]: node.session.auth.chap_algs = MD5
Apr 17 10:38:49 user nova-compute[82522]: node.session.timeo.replacement_timeout = 120
Apr 17 10:38:49 user nova-compute[82522]: node.session.err_timeo.abort_timeout = 15
Apr 17 10:38:49 user nova-compute[82522]: node.session.err_timeo.lu_reset_timeout = 30
Apr 17 10:38:49 user nova-compute[82522]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 17 10:38:49 user nova-compute[82522]: node.session.err_timeo.host_reset_timeout = 60
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.FastAbort = Yes
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.InitialR2T = No
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.ImmediateData = Yes
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.FirstBurstLength = 262144
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.MaxBurstLength = 16776192
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.DefaultTime2Retain = 0
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.DefaultTime2Wait = 2
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.MaxConnections = 1
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 17 10:38:49 user nova-compute[82522]: node.session.iscsi.ERL = 0
Apr 17 10:38:49 user nova-compute[82522]: node.session.scan = manual
Apr 17 10:38:49 user nova-compute[82522]: node.session.reopen_max = 0
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].address = 172.16.0.220
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].port = 3260
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].startup = manual
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].tcp.window_size = 524288
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].tcp.type_of_service = 0
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].timeo.logout_timeout = 15
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].timeo.login_timeout = 15
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].timeo.auth_timeout = 45
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].timeo.noop_out_interval = 5
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].timeo.noop_out_timeout = 5
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].iscsi.HeaderDigest = None
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].iscsi.DataDigest = None
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].iscsi.IFMarker = No
Apr 17 10:38:49 user nova-compute[82522]: node.conn[0].iscsi.OFMarker = No
Apr 17 10:38:49 user nova-compute[82522]: # END RECORD
Apr 17 10:38:49 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:38:49 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:38:49 user nova-compute[82522]:   <source dev="/dev/sdf"/>
Apr 17 10:38:49 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:38:49 user nova-compute[82522]:   <serial>74dc9a66-6730-41d3-95e1-920360e21cb9</serial>
Apr 17 10:38:49 user nova-compute[82522]: </disk>
Apr 17 10:38:49 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a42a861-1375-4cff-a29a-a9a077dd408c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a546d-dcb4-46df-bf9b-2d1c9d46f830]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaVRPKep {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaVRPKep" returned: 0 in 0.052s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf607450-c2ca-49aa-8c4b-ec6634dfaf6e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xaVRPKep'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd7bd75-feeb-4724-ba7d-367b92076f8d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e564e1bc-85a0-4391-8c3f-bf81daf061b4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 (non-flash)
Apr 17 10:38:50 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] HCTL ('35', '0', '0', 0) found on session 18 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cf4a8b-3678-4f9d-9794-454820f7e898]: (4, ('0 0 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.400s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Searching for a device in session 18 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaVRPKep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.343s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] <== connect_volume: return (765ms) {'type': 'block', 'scsi_wwn': '23664636438343461', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664636438343461', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-149216570',display_name='tempest-ServerStableDeviceRescueTest-server-149216570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-149216570',id=5,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMwn+C+1/WvqV85P8Z+0YbdwvuPA1JRVCsTkMku5wTk3lWyccqRP3BA+GEJxUJW41c3kbKZgFZYKS36Yqqk/bayBcZoFHQqGTKsw0QCKdBNYqIi+SXQR7Q9/idwCJCSQQ==',key_name='tempest-keypair-690522544',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:35:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850462faec874544bdc01dd14746d558',ramdisk_id='',reservation_id='r-rmln8x19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1756156966',owner_user_name='tempest-ServerStableDeviceRescueTest-1756156966-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='282298df65264595b5d7351066128b1a',uuid=e0b1074e-7352-437a-b2ec-1eaefc5bf1b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "vif_mac": "fa:16:3e:59:c9:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Converting VIF {"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "vif_mac": "fa:16:3e:59:c9:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:c9:94,bridge_name='br-int',has_traffic_filtering=True,id=f839dea5-4294-4842-bfa2-262351dabfb9,network=Network(95203f9a-7934-486d-b36d-13d2317f1102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf839dea5-42') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.objects.instance [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'pci_devices' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:38:50 user nova-compute[82522]:   <uuid>e0b1074e-7352-437a-b2ec-1eaefc5bf1b4</uuid>
Apr 17 10:38:50 user nova-compute[82522]:   <name>instance-00000005</name>
Apr 17 10:38:50 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:38:50 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:38:50 user nova-compute[82522]:   <metadata>
Apr 17 10:38:50 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:38:50 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:38:50 user nova-compute[82522]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-149216570</nova:name>
Apr 17 10:38:50 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:38:49</nova:creationTime>
Apr 17 10:38:50 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:38:50 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:38:50 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:38:50 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:38:50 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:38:50 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:38:50 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:38:50 user nova-compute[82522]:       <nova:owner>
Apr 17 10:38:50 user nova-compute[82522]:         <nova:user uuid="282298df65264595b5d7351066128b1a">tempest-ServerStableDeviceRescueTest-1756156966-project-member</nova:user>
Apr 17 10:38:50 user nova-compute[82522]:         <nova:project uuid="850462faec874544bdc01dd14746d558">tempest-ServerStableDeviceRescueTest-1756156966</nova:project>
Apr 17 10:38:50 user nova-compute[82522]:       </nova:owner>
Apr 17 10:38:50 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:38:50 user nova-compute[82522]:       <nova:ports>
Apr 17 10:38:50 user nova-compute[82522]:         <nova:port uuid="f839dea5-4294-4842-bfa2-262351dabfb9">
Apr 17 10:38:50 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:38:50 user nova-compute[82522]:         </nova:port>
Apr 17 10:38:50 user nova-compute[82522]:       </nova:ports>
Apr 17 10:38:50 user nova-compute[82522]:     </nova:instance>
Apr 17 10:38:50 user nova-compute[82522]:   </metadata>
Apr 17 10:38:50 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:38:50 user nova-compute[82522]:     <system>
Apr 17 10:38:50 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:38:50 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:38:50 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:38:50 user nova-compute[82522]:       <entry name="serial">e0b1074e-7352-437a-b2ec-1eaefc5bf1b4</entry>
Apr 17 10:38:50 user nova-compute[82522]:       <entry name="uuid">e0b1074e-7352-437a-b2ec-1eaefc5bf1b4</entry>
Apr 17 10:38:50 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:38:50 user nova-compute[82522]:     </system>
Apr 17 10:38:50 user nova-compute[82522]:   </sysinfo>
Apr 17 10:38:50 user nova-compute[82522]:   <os>
Apr 17 10:38:50 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:38:50 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:38:50 user nova-compute[82522]:   </os>
Apr 17 10:38:50 user nova-compute[82522]:   <features>
Apr 17 10:38:50 user nova-compute[82522]:     <acpi/>
Apr 17 10:38:50 user nova-compute[82522]:     <apic/>
Apr 17 10:38:50 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:38:50 user nova-compute[82522]:   </features>
Apr 17 10:38:50 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:38:50 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:38:50 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:38:50 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:38:50 user nova-compute[82522]:   </clock>
Apr 17 10:38:50 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:38:50 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:38:50 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:38:50 user nova-compute[82522]:   </cpu>
Apr 17 10:38:50 user nova-compute[82522]:   <devices>
Apr 17 10:38:50 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:38:50 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:38:50 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk"/>
Apr 17 10:38:50 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:38:50 user nova-compute[82522]:     </disk>
Apr 17 10:38:50 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:38:50 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:38:50 user nova-compute[82522]:       <source dev="/dev/sdd"/>
Apr 17 10:38:50 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:38:50 user nova-compute[82522]:       <serial>bdf94f31-0fa3-4682-abb5-161b0e318367</serial>
Apr 17 10:38:50 user nova-compute[82522]:     </disk>
Apr 17 10:38:50 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:38:50 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:38:50 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue"/>
Apr 17 10:38:50 user nova-compute[82522]:       <target dev="vdc" bus="virtio"/>
Apr 17 10:38:50 user nova-compute[82522]:       <boot order="1"/>
Apr 17 10:38:50 user nova-compute[82522]:     </disk>
Apr 17 10:38:50 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:38:50 user nova-compute[82522]:       <mac address="fa:16:3e:59:c9:94"/>
Apr 17 10:38:50 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:50 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:38:50 user nova-compute[82522]:       <target dev="tapf839dea5-42"/>
Apr 17 10:38:50 user nova-compute[82522]:     </interface>
Apr 17 10:38:50 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:38:50 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/console.log" append="off"/>
Apr 17 10:38:50 user nova-compute[82522]:     </serial>
Apr 17 10:38:50 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:38:50 user nova-compute[82522]:     <video>
Apr 17 10:38:50 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:38:50 user nova-compute[82522]:     </video>
Apr 17 10:38:50 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:38:50 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:38:50 user nova-compute[82522]:     </rng>
Apr 17 10:38:50 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:38:50 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:38:50 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:38:50 user nova-compute[82522]:     </memballoon>
Apr 17 10:38:50 user nova-compute[82522]:   </devices>
Apr 17 10:38:50 user nova-compute[82522]: </domain>
Apr 17 10:38:50 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:38:50 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Instance destroyed successfully.
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] No VIF found with MAC fa:16:3e:59:c9:94, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No VIF found with MAC fa:16:3e:f8:08:93, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:38:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.307s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:52 user nova-compute[82522]: INFO nova.compute.manager [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Detaching volume 74dc9a66-6730-41d3-95e1-920360e21cb9
Apr 17 10:38:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:52 user nova-compute[82522]: INFO nova.virt.block_device [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attempting to driver detach volume 74dc9a66-6730-41d3-95e1-920360e21cb9 from mountpoint /dev/vdb
Apr 17 10:38:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Attempting to detach device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:38:52 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:38:52 user nova-compute[82522]:   <source dev="/dev/sdf"/>
Apr 17 10:38:52 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:38:52 user nova-compute[82522]:   <serial>74dc9a66-6730-41d3-95e1-920360e21cb9</serial>
Apr 17 10:38:52 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:38:52 user nova-compute[82522]: </disk>
Apr 17 10:38:52 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:38:52 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully detached device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the persistent domain config.
Apr 17 10:38:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7792cf72-dc73-4201-9501-4515ce860735 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:38:52 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:38:52 user nova-compute[82522]:   <source dev="/dev/sdf"/>
Apr 17 10:38:52 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:38:52 user nova-compute[82522]:   <serial>74dc9a66-6730-41d3-95e1-920360e21cb9</serial>
Apr 17 10:38:52 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:38:52 user nova-compute[82522]: </disk>
Apr 17 10:38:52 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:52 user nova-compute[82522]: WARNING nova.compute.manager [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state active and task_state rescuing.
Apr 17 10:38:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681727932.7886686, 7792cf72-dc73-4201-9501-4515ce860735 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:38:52 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully detached device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the live domain config.
Apr 17 10:38:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYoZGUCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:38:52 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[898d67dc-476d-4eba-9870-c5ec543048a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:38:52 user nova-compute[82522]: No targets found.
Apr 17 10:38:52 user nova-compute[82522]: iSNS:
Apr 17 10:38:52 user nova-compute[82522]: No targets found.
Apr 17 10:38:52 user nova-compute[82522]: STATIC:
Apr 17 10:38:52 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:38:52 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:38:52 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:38:52 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9
Apr 17 10:38:52 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:38:52 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:38:52 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:38:52 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:38:52 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:38:52 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67
Apr 17 10:38:52 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:38:52 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:38:52 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:38:52 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:38:52 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:38:52 user nova-compute[82522]: FIRMWARE:
Apr 17 10:38:52 user nova-compute[82522]: No targets found.
Apr 17 10:38:52 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:38:52 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:38:52 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee921137-2cbd-4358-b3b5-fb9974082078]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[35920e3c-d4ec-425d-b43f-6483a36d1fa8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 (non-flash)
Apr 17 10:38:52 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2846f3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9'): ({'sdf'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Removing single pathed devices sdf {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c14df7-173f-4e39-8909-dde6e2d2cd7f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff32632-ad71-4a1e-a901-a5c245643407]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Flushing IO for device /dev/sdf {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.036s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c137e1db-710d-48b0-8a21-31508252c864]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.076s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddf74a3-dfb6-46b3-8c1a-0e8d403aa786]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06cb285-82f7-481c-bcd9-1348e1592a5b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7f93f8-f84d-4787-9bad-e10f78a9a6aa]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9, portal: 172.16.0.220,3260]
Apr 17 10:38:53 user nova-compute[82522]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9, portal: 172.16.0.220,3260] successful.
Apr 17 10:38:53 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc9a66-6730-41d3-95e1-920360e21cb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b0199a-300b-40e2-bebd-a5c3cef1191b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.479s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== disconnect_volume: return (481ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:54 user nova-compute[82522]: DEBUG nova.objects.instance [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:38:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.523s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:38:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:38:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:38:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:38:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:38:54 user nova-compute[82522]: WARNING nova.compute.manager [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state active and task_state rescuing.
Apr 17 10:38:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:38:55 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727935.1467674, e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] VM Resumed (Lifecycle Event)
Apr 17 10:38:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 17 10:38:55 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727935.1505275, e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:38:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] VM Started (Lifecycle Event)
Apr 17 10:38:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:38:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:38:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 17 10:38:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:38:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:39:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:05 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:39:05 user nova-compute[82522]: INFO nova.compute.claims [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Claim successful on node user
Apr 17 10:39:05 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:39:05 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:39:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:39:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.policy [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:39:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Creating image(s)
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "/opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "/opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk 1073741824" returned: 0 in 0.052s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Successfully created port: b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Cannot resize image /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lazy-loading 'migration_context' on Instance uuid 5e03807e-942b-4155-835b-b1c86f5b80f5 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Ensure instance console log exists: /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Successfully updated port: b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "refresh_cache-5e03807e-942b-4155-835b-b1c86f5b80f5" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquired lock "refresh_cache-5e03807e-942b-4155-835b-b1c86f5b80f5" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-changed-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Refreshing instance network info cache due to event network-changed-b7885763-79d0-44c2-bc9d-4a434792584a. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] Acquiring lock "refresh_cache-5e03807e-942b-4155-835b-b1c86f5b80f5" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Updating instance_info_cache with network_info: [{"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Releasing lock "refresh_cache-5e03807e-942b-4155-835b-b1c86f5b80f5" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Instance network_info: |[{"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] Acquired lock "refresh_cache-5e03807e-942b-4155-835b-b1c86f5b80f5" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.network.neutron [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Refreshing network info cache for port b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Start _get_guest_xml network_info=[{"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:39:07 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:39:07 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-604329460',display_name='tempest-ServersNegativeTestJSON-server-604329460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-604329460',id=15,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b831c3b6c244dda1821583a6b8cd08',ramdisk_id='',reservation_id='r-iki3zlm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-812869679',owner_user_name='tempest-ServersNegativeTestJSON-812869679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:39:06Z,user_data=None,user_id='1e61a5e172c34636b183ef9c84b714d8',uuid=5e03807e-942b-4155-835b-b1c86f5b80f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converting VIF {"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=b7885763-79d0-44c2-bc9d-4a434792584a,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7885763-79') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:39:07 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e03807e-942b-4155-835b-b1c86f5b80f5 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:39:08 user nova-compute[82522]:   <uuid>5e03807e-942b-4155-835b-b1c86f5b80f5</uuid>
Apr 17 10:39:08 user nova-compute[82522]:   <name>instance-0000000f</name>
Apr 17 10:39:08 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:39:08 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:39:08 user nova-compute[82522]:   <metadata>
Apr 17 10:39:08 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:39:08 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:39:08 user nova-compute[82522]:       <nova:name>tempest-ServersNegativeTestJSON-server-604329460</nova:name>
Apr 17 10:39:08 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:39:07</nova:creationTime>
Apr 17 10:39:08 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:39:08 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:39:08 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:39:08 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:39:08 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:39:08 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:39:08 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:39:08 user nova-compute[82522]:       <nova:owner>
Apr 17 10:39:08 user nova-compute[82522]:         <nova:user uuid="1e61a5e172c34636b183ef9c84b714d8">tempest-ServersNegativeTestJSON-812869679-project-member</nova:user>
Apr 17 10:39:08 user nova-compute[82522]:         <nova:project uuid="a8b831c3b6c244dda1821583a6b8cd08">tempest-ServersNegativeTestJSON-812869679</nova:project>
Apr 17 10:39:08 user nova-compute[82522]:       </nova:owner>
Apr 17 10:39:08 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:39:08 user nova-compute[82522]:       <nova:ports>
Apr 17 10:39:08 user nova-compute[82522]:         <nova:port uuid="b7885763-79d0-44c2-bc9d-4a434792584a">
Apr 17 10:39:08 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 17 10:39:08 user nova-compute[82522]:         </nova:port>
Apr 17 10:39:08 user nova-compute[82522]:       </nova:ports>
Apr 17 10:39:08 user nova-compute[82522]:     </nova:instance>
Apr 17 10:39:08 user nova-compute[82522]:   </metadata>
Apr 17 10:39:08 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:39:08 user nova-compute[82522]:     <system>
Apr 17 10:39:08 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:39:08 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:39:08 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:39:08 user nova-compute[82522]:       <entry name="serial">5e03807e-942b-4155-835b-b1c86f5b80f5</entry>
Apr 17 10:39:08 user nova-compute[82522]:       <entry name="uuid">5e03807e-942b-4155-835b-b1c86f5b80f5</entry>
Apr 17 10:39:08 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:39:08 user nova-compute[82522]:     </system>
Apr 17 10:39:08 user nova-compute[82522]:   </sysinfo>
Apr 17 10:39:08 user nova-compute[82522]:   <os>
Apr 17 10:39:08 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:39:08 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:39:08 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:39:08 user nova-compute[82522]:   </os>
Apr 17 10:39:08 user nova-compute[82522]:   <features>
Apr 17 10:39:08 user nova-compute[82522]:     <acpi/>
Apr 17 10:39:08 user nova-compute[82522]:     <apic/>
Apr 17 10:39:08 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:39:08 user nova-compute[82522]:   </features>
Apr 17 10:39:08 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:39:08 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:39:08 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:39:08 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:39:08 user nova-compute[82522]:   </clock>
Apr 17 10:39:08 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:39:08 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:39:08 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:39:08 user nova-compute[82522]:   </cpu>
Apr 17 10:39:08 user nova-compute[82522]:   <devices>
Apr 17 10:39:08 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:39:08 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:39:08 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk"/>
Apr 17 10:39:08 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:39:08 user nova-compute[82522]:     </disk>
Apr 17 10:39:08 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:39:08 user nova-compute[82522]:       <mac address="fa:16:3e:84:2e:b9"/>
Apr 17 10:39:08 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:39:08 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:39:08 user nova-compute[82522]:       <target dev="tapb7885763-79"/>
Apr 17 10:39:08 user nova-compute[82522]:     </interface>
Apr 17 10:39:08 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:39:08 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/console.log" append="off"/>
Apr 17 10:39:08 user nova-compute[82522]:     </serial>
Apr 17 10:39:08 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:39:08 user nova-compute[82522]:     <video>
Apr 17 10:39:08 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:39:08 user nova-compute[82522]:     </video>
Apr 17 10:39:08 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:39:08 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:39:08 user nova-compute[82522]:     </rng>
Apr 17 10:39:08 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:39:08 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:39:08 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:39:08 user nova-compute[82522]:     </memballoon>
Apr 17 10:39:08 user nova-compute[82522]:   </devices>
Apr 17 10:39:08 user nova-compute[82522]: </domain>
Apr 17 10:39:08 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-604329460',display_name='tempest-ServersNegativeTestJSON-server-604329460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-604329460',id=15,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b831c3b6c244dda1821583a6b8cd08',ramdisk_id='',reservation_id='r-iki3zlm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-812869679',owner_user_name='tempest-ServersNegativeTestJSON-812869679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:39:06Z,user_data=None,user_id='1e61a5e172c34636b183ef9c84b714d8',uuid=5e03807e-942b-4155-835b-b1c86f5b80f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converting VIF {"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=b7885763-79d0-44c2-bc9d-4a434792584a,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7885763-79') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG os_vif [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=b7885763-79d0-44c2-bc9d-4a434792584a,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7885763-79') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7885763-79, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7885763-79, col_values=(('external_ids', {'iface-id': 'b7885763-79d0-44c2-bc9d-4a434792584a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:2e:b9', 'vm-uuid': '5e03807e-942b-4155-835b-b1c86f5b80f5'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:08 user nova-compute[82522]: INFO os_vif [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=b7885763-79d0-44c2-bc9d-4a434792584a,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7885763-79')
Apr 17 10:39:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] No VIF found with MAC fa:16:3e:84:2e:b9, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Updated VIF entry in instance network info cache for port b7885763-79d0-44c2-bc9d-4a434792584a. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Updating instance_info_cache with network_info: [{"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] Releasing lock "refresh_cache-5e03807e-942b-4155-835b-b1c86f5b80f5" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:39:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:39:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] No waiting events found dispatching network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:39:09 user nova-compute[82522]: WARNING nova.compute.manager [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received unexpected event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a for instance with vm_state building and task_state spawning.
Apr 17 10:39:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727951.5903766, 5e03807e-942b-4155-835b-b1c86f5b80f5 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:39:11 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] VM Resumed (Lifecycle Event)
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:39:11 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Instance spawned successfully.
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:39:11 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681727951.5957575, 5e03807e-942b-4155-835b-b1c86f5b80f5 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:39:11 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] VM Started (Lifecycle Event)
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:39:11 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:39:11 user nova-compute[82522]: INFO nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] No waiting events found dispatching network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:39:11 user nova-compute[82522]: WARNING nova.compute.manager [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received unexpected event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a for instance with vm_state building and task_state spawning.
Apr 17 10:39:11 user nova-compute[82522]: INFO nova.compute.manager [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Took 6.26 seconds to build instance.
Apr 17 10:39:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.370s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:39:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:39:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:14 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:39:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:39:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 60008675-7786-4a26-9640-49da6efd0adb {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updating instance_info_cache with network_info: [{"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:39:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:39:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:19 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:39:19 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:39:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:39:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:39:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:25 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:39:25 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=7718MB free_disk=26.537227630615234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 59fd26de-d46e-4f41-91f6-090005a07d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 7792cf72-dc73-4201-9501-4515ce860735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:39:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:39:26 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:39:26 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:39:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:39:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:47 user nova-compute[82522]: DEBUG nova.objects.instance [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:39:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.210s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:47 user nova-compute[82522]: INFO nova.compute.manager [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attaching volume 0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 to /dev/vdb
Apr 17 10:39:48 user nova-compute[82522]: DEBUG os_brick.utils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c676de4-c382-4cdb-9e7f-2e136afe7bac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14f09cf-0550-48bc-ad42-32bdf123e11e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1731abe4-10dc-46d6-ada6-a8a547d27a2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a81ca26-8b12-444f-b5ca-e9babca38224]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:39:48 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:39:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a997813d-d0d5-490f-a229-1058a0e6e6eb]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG os_brick.utils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating existing volume attachment record: 53cad201-2759-494a-80f0-78912e0a815c {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:39:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-changed-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:39:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Refreshing instance network info cache due to event network-changed-3106e21d-664e-4c17-85be-f0a654c4eabc. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:39:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] Acquiring lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:39:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] Acquired lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:39:51 user nova-compute[82522]: DEBUG nova.network.neutron [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Refreshing network info cache for port 3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:39:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "interface-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "interface-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'flavor' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:39:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'pci_requests' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:39:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:39:52 user nova-compute[82522]: DEBUG nova.policy [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:39:52 user nova-compute[82522]: DEBUG nova.network.neutron [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updated VIF entry in instance network info cache for port 3106e21d-664e-4c17-85be-f0a654c4eabc. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:39:52 user nova-compute[82522]: DEBUG nova.network.neutron [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updating instance_info_cache with network_info: [{"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:39:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] Releasing lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:39:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:53 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Successfully created port: c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:39:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Successfully updated port: c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:39:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:39:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquired lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:39:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:39:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-changed-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:39:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Refreshing instance network info cache due to event network-changed-c7efbdb0-e5e1-498a-890a-2f670253e25e. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:39:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] Acquiring lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updating instance_info_cache with network_info: [{"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Releasing lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] Acquired lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.network.neutron [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Refreshing network info cache for port c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1840654553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1840654553',id=12,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA==',key_name='tempest-keypair-1227280417',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='507228fb562e461e91a628829ce32d80',ramdisk_id='',reservation_id='r-fakqiiql',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382963185',owner_user_name='tempest-TaggedAttachmentsTest-1382963185-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab512fbd85694415a5f7af8b689814d4',uuid=9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converting VIF {"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_vif [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7efbdb0-e5, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7efbdb0-e5, col_values=(('external_ids', {'iface-id': 'c7efbdb0-e5e1-498a-890a-2f670253e25e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:ed:c9', 'vm-uuid': '9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:55 user nova-compute[82522]: INFO os_vif [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5')
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1840654553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1840654553',id=12,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA==',key_name='tempest-keypair-1227280417',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='507228fb562e461e91a628829ce32d80',ramdisk_id='',reservation_id='r-fakqiiql',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382963185',owner_user_name='tempest-TaggedAttachmentsTest-1382963185-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab512fbd85694415a5f7af8b689814d4',uuid=9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converting VIF {"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] attach device xml: <interface type="ethernet">
Apr 17 10:39:55 user nova-compute[82522]:   <mac address="fa:16:3e:0e:ed:c9"/>
Apr 17 10:39:55 user nova-compute[82522]:   <model type="virtio"/>
Apr 17 10:39:55 user nova-compute[82522]:   <mtu size="1442"/>
Apr 17 10:39:55 user nova-compute[82522]:   <target dev="tapc7efbdb0-e5"/>
Apr 17 10:39:55 user nova-compute[82522]: </interface>
Apr 17 10:39:55 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNCZhAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:39:55 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:39:55 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:39:55 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e371c2-5091-4578-9f8d-36cfc47ea4bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:39:55 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1884967f-80bf-49ad-8161-eb08d8dae9a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224] added
Apr 17 10:39:55 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f84ca2-a1fe-453b-97f9-7d651717e860]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b42d1b-a6ad-411d-a29c-492a98ec4d03]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzNCZhAV {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzNCZhAV" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6b3e85-4702-4477-9c49-05fcca735bed]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RzNCZhAV'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-plugged-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] No waiting events found dispatching network-vif-plugged-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:39:55 user nova-compute[82522]: WARNING nova.compute.manager [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received unexpected event network-vif-plugged-c7efbdb0-e5e1-498a-890a-2f670253e25e for instance with vm_state active and task_state None.
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e65bd0-827e-468e-bc40-5a08831efb53]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c30592c-400d-40d9-b385-4250cc36123b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] No BDM found with device name hda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] No VIF found with MAC fa:16:3e:b0:13:f7, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41fd9a2-5ecf-49e8-ba31-d0d67b53347b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224, portal: 172.16.0.220,3260]
Apr 17 10:39:56 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224, portal: 172.16.0.220,3260] successful.
Apr 17 10:39:56 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:39:56 user nova-compute[82522]:   <nova:package version="0.0.0"/>
Apr 17 10:39:56 user nova-compute[82522]:   <nova:name>tempest-device-tagging-server-1840654553</nova:name>
Apr 17 10:39:56 user nova-compute[82522]:   <nova:creationTime>2023-04-17 10:39:56</nova:creationTime>
Apr 17 10:39:56 user nova-compute[82522]:   <nova:flavor name="m1.nano">
Apr 17 10:39:56 user nova-compute[82522]:     <nova:memory>128</nova:memory>
Apr 17 10:39:56 user nova-compute[82522]:     <nova:disk>1</nova:disk>
Apr 17 10:39:56 user nova-compute[82522]:     <nova:swap>0</nova:swap>
Apr 17 10:39:56 user nova-compute[82522]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:39:56 user nova-compute[82522]:     <nova:vcpus>1</nova:vcpus>
Apr 17 10:39:56 user nova-compute[82522]:   </nova:flavor>
Apr 17 10:39:56 user nova-compute[82522]:   <nova:owner>
Apr 17 10:39:56 user nova-compute[82522]:     <nova:user uuid="ab512fbd85694415a5f7af8b689814d4">tempest-TaggedAttachmentsTest-1382963185-project-member</nova:user>
Apr 17 10:39:56 user nova-compute[82522]:     <nova:project uuid="507228fb562e461e91a628829ce32d80">tempest-TaggedAttachmentsTest-1382963185</nova:project>
Apr 17 10:39:56 user nova-compute[82522]:   </nova:owner>
Apr 17 10:39:56 user nova-compute[82522]:   <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:39:56 user nova-compute[82522]:   <nova:ports>
Apr 17 10:39:56 user nova-compute[82522]:     <nova:port uuid="3106e21d-664e-4c17-85be-f0a654c4eabc">
Apr 17 10:39:56 user nova-compute[82522]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:39:56 user nova-compute[82522]:     </nova:port>
Apr 17 10:39:56 user nova-compute[82522]:     <nova:port uuid="c7efbdb0-e5e1-498a-890a-2f670253e25e">
Apr 17 10:39:56 user nova-compute[82522]:       <nova:ip type="fixed" address="10.10.10.236" ipVersion="4"/>
Apr 17 10:39:56 user nova-compute[82522]:     </nova:port>
Apr 17 10:39:56 user nova-compute[82522]:   </nova:ports>
Apr 17 10:39:56 user nova-compute[82522]: </nova:instance>
Apr 17 10:39:56 user nova-compute[82522]:  {{(pid=82522) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf80c4-a251-4f3b-8e4b-b34d27b7aace]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updated VIF entry in instance network info cache for port c7efbdb0-e5e1-498a-890a-2f670253e25e. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updating instance_info_cache with network_info: [{"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "interface-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.106s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb05184-ace0-4ae0-9687-53da55697fdd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 (non-flash)
Apr 17 10:39:56 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] Releasing lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cb7119-aba2-43c6-bd75-5fc7117aeb13]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNCZhAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG nova.objects.instance [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'flavor' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:56 user nova-compute[82522]: INFO nova.compute.manager [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Attaching volume d64516c4-d9fa-4b15-9f2e-ed17e48f67ed to /dev/vdb
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.utils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b966dbab-0454-48ad-94df-03c2c2d046f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde0b849-a409-40ba-9cb5-4ec7431e723e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86c7d38-2013-44b6-8f96-eedecd8c0959]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e56611-2658-40b7-b36c-06ccdc43d799]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:39:56 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:39:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c132a-4074-41c2-acf4-0c359593ae80]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG os_brick.utils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:39:56 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updating existing volume attachment record: f0357749-4810-4cb8-8798-5b9740071b28 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:39:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:39:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26333643436373132', 'path': '/dev/sdf'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:39:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333643436373132', 'path': '/dev/sdf'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:39:57 user nova-compute[82522]: DEBUG nova.objects.instance [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:39:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:39:57 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:39:57 user nova-compute[82522]:   <source dev="/dev/sdf"/>
Apr 17 10:39:57 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:39:57 user nova-compute[82522]:   <serial>0cd53fd2-fb00-4222-bb25-1f2fcd3b5224</serial>
Apr 17 10:39:57 user nova-compute[82522]: </disk>
Apr 17 10:39:57 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:39:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:39:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:39:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No VIF found with MAC fa:16:3e:f8:08:93, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:39:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.198s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-plugged-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:39:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:39:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] No waiting events found dispatching network-vif-plugged-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:39:58 user nova-compute[82522]: WARNING nova.compute.manager [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received unexpected event network-vif-plugged-c7efbdb0-e5e1-498a-890a-2f670253e25e for instance with vm_state active and task_state None.
Apr 17 10:39:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:39:59 user nova-compute[82522]: INFO nova.compute.manager [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Detaching volume 0cd53fd2-fb00-4222-bb25-1f2fcd3b5224
Apr 17 10:39:59 user nova-compute[82522]: INFO nova.virt.block_device [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attempting to driver detach volume 0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 from mountpoint /dev/vdb
Apr 17 10:39:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Attempting to detach device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:39:59 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:39:59 user nova-compute[82522]:   <source dev="/dev/sdf"/>
Apr 17 10:39:59 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:39:59 user nova-compute[82522]:   <serial>0cd53fd2-fb00-4222-bb25-1f2fcd3b5224</serial>
Apr 17 10:39:59 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:39:59 user nova-compute[82522]: </disk>
Apr 17 10:39:59 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:39:59 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully detached device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the persistent domain config.
Apr 17 10:39:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7792cf72-dc73-4201-9501-4515ce860735 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:39:59 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:39:59 user nova-compute[82522]:   <source dev="/dev/sdf"/>
Apr 17 10:39:59 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:39:59 user nova-compute[82522]:   <serial>0cd53fd2-fb00-4222-bb25-1f2fcd3b5224</serial>
Apr 17 10:39:59 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:39:59 user nova-compute[82522]: </disk>
Apr 17 10:39:59 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681727999.6013458, 7792cf72-dc73-4201-9501-4515ce860735 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:39:59 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully detached device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the live domain config.
Apr 17 10:39:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNCZhAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:39:59 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e39f0b3-2a72-4154-ad07-c9b37655883b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:39:59 user nova-compute[82522]: No targets found.
Apr 17 10:39:59 user nova-compute[82522]: iSNS:
Apr 17 10:39:59 user nova-compute[82522]: No targets found.
Apr 17 10:39:59 user nova-compute[82522]: STATIC:
Apr 17 10:39:59 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:39:59 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:39:59 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:39:59 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:39:59 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:39:59 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:39:59 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67
Apr 17 10:39:59 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:39:59 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:39:59 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224
Apr 17 10:39:59 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:39:59 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:39:59 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:39:59 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:39:59 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:39:59 user nova-compute[82522]: FIRMWARE:
Apr 17 10:39:59 user nova-compute[82522]: No targets found.
Apr 17 10:39:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:39:59 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:39:59 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c12744-b2f0-46ac-b944-a46a2d7ea95f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9215545-95b9-4b6f-9ccf-5cbc822decab]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 (non-flash)
Apr 17 10:39:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa284610f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224'): ({'sdf'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Removing single pathed devices sdf {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dc0137-c2a1-4f17-b7c6-739c0757143c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae98707-420f-42fd-b938-551475100de4]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Flushing IO for device /dev/sdf {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[067736a2-e8ff-459d-a3fd-910c37f9828c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ec7872-68ee-4a9e-98f2-b3f7b5ac6534]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e66563-bd77-4f8d-9e63-f756a0880878]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[234db590-584c-4ca4-9ee9-f50878d2c542]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224, portal: 172.16.0.220,3260]
Apr 17 10:39:59 user nova-compute[82522]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224, portal: 172.16.0.220,3260] successful.
Apr 17 10:39:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7427888c-e864-428c-b6e7-0f4dae079e03]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== disconnect_volume: return (354ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:39:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:40:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:00 user nova-compute[82522]: DEBUG nova.objects.instance [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.917s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:40:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfKiOwBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:01 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:40:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d7536f-5ef9-42ff-89fc-b5855882b615]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:40:02 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c60f6fc-6867-47ba-84d6-573126ffc1ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed] added
Apr 17 10:40:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f95792-4ec0-4b99-a0f4-ae595732155d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bfbb46-4173-45ee-a432-39a3497872d2]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfKiOwBD {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfKiOwBD" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de4eb73-3b4a-41bb-9186-cb78531eaed9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfKiOwBD'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[057aa67e-8466-41ea-87a1-c611c253de90]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[367356de-0c4d-45b0-b1a8-06801d79b250]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5510545-5de3-4328-985c-de35cac9ca01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed, portal: 172.16.0.220,3260]
Apr 17 10:40:02 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed, portal: 172.16.0.220,3260] successful.
Apr 17 10:40:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e98d26-58ba-4556-855e-efed6e87d672]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea02b29b-5eff-454a-a919-e04c11e06da3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed (non-flash)
Apr 17 10:40:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:02 user nova-compute[82522]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed (non-flash)
Apr 17 10:40:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a280f53-313b-47e9-a880-c19c342a8905]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:40:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfKiOwBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23036643831366339', 'path': '/dev/sdf'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036643831366339', 'path': '/dev/sdf'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG nova.objects.instance [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'flavor' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:40:03 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:03 user nova-compute[82522]:   <source dev="/dev/sdf"/>
Apr 17 10:40:03 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:40:03 user nova-compute[82522]:   <serial>d64516c4-d9fa-4b15-9f2e-ed17e48f67ed</serial>
Apr 17 10:40:03 user nova-compute[82522]: </disk>
Apr 17 10:40:03 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] No BDM found with device name hda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] No VIF found with MAC fa:16:3e:b0:13:f7, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:40:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.199s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:04 user nova-compute[82522]: INFO nova.compute.manager [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Detaching volume d64516c4-d9fa-4b15-9f2e-ed17e48f67ed
Apr 17 10:40:04 user nova-compute[82522]: INFO nova.virt.block_device [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Attempting to driver detach volume d64516c4-d9fa-4b15-9f2e-ed17e48f67ed from mountpoint /dev/vdb
Apr 17 10:40:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Attempting to detach device vdb from instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:40:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:40:04 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:04 user nova-compute[82522]:   <source dev="/dev/sdf"/>
Apr 17 10:40:04 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:40:04 user nova-compute[82522]:   <serial>d64516c4-d9fa-4b15-9f2e-ed17e48f67ed</serial>
Apr 17 10:40:04 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 17 10:40:04 user nova-compute[82522]: </disk>
Apr 17 10:40:04 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Successfully detached device vdb from instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 from the persistent domain config.
Apr 17 10:40:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:40:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:40:04 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:04 user nova-compute[82522]:   <source dev="/dev/sdf"/>
Apr 17 10:40:04 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:40:04 user nova-compute[82522]:   <serial>d64516c4-d9fa-4b15-9f2e-ed17e48f67ed</serial>
Apr 17 10:40:04 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 17 10:40:04 user nova-compute[82522]: </disk>
Apr 17 10:40:04 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728005.4586034, 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:40:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Successfully detached device vdb from instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 from the live domain config.
Apr 17 10:40:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfKiOwBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:05 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c3059e-c143-4a73-9403-68a25a123b0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:40:05 user nova-compute[82522]: No targets found.
Apr 17 10:40:05 user nova-compute[82522]: iSNS:
Apr 17 10:40:05 user nova-compute[82522]: No targets found.
Apr 17 10:40:05 user nova-compute[82522]: STATIC:
Apr 17 10:40:05 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:40:05 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:05 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:05 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:40:05 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:05 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:05 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed
Apr 17 10:40:05 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:05 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:05 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67
Apr 17 10:40:05 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:05 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:05 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:40:05 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:05 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:05 user nova-compute[82522]: FIRMWARE:
Apr 17 10:40:05 user nova-compute[82522]: No targets found.
Apr 17 10:40:05 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:40:05 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:40:05 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[85846075-f19b-46d9-b303-62a76b4f2317]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3348a681-708f-45b8-8edf-e7037b79b29b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:05 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:05 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:05 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:05 user nova-compute[82522]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed (non-flash)
Apr 17 10:40:05 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:05 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:05 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:05 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:05 user nova-compute[82522]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed (non-flash)
Apr 17 10:40:05 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2846c9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed'): ({'sdf'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Removing single pathed devices sdf {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ea4283-9840-472e-ba16-3ffd7015c2f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b2c64-a1a0-4e2a-825b-d2307a43f5c0]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Flushing IO for device /dev/sdf {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c639ca-95c5-4dd6-8b5e-9d78f5d3f982]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e0e25f-560c-4c56-b854-66f67910d39d]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bf16aa-c0cc-4013-9e7e-12df3217312a]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6470eec-d41b-4afc-a33d-57d1ed1bf80b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed, portal: 172.16.0.220,3260]
Apr 17 10:40:05 user nova-compute[82522]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed, portal: 172.16.0.220,3260] successful.
Apr 17 10:40:05 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64516c4-d9fa-4b15-9f2e-ed17e48f67ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[368cb610-37d8-4877-972a-85fa996e3664]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] <== disconnect_volume: return (320ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:40:06 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'flavor' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.721s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "interface-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-c7efbdb0-e5e1-498a-890a-2f670253e25e" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "interface-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-c7efbdb0-e5e1-498a-890a-2f670253e25e" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.objects.instance [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'flavor' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1840654553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1840654553',id=12,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA==',key_name='tempest-keypair-1227280417',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='507228fb562e461e91a628829ce32d80',ramdisk_id='',reservation_id='r-fakqiiql',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382963185',owner_user_name='tempest-TaggedAttachmentsTest-1382963185-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab512fbd85694415a5f7af8b689814d4',uuid=9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converting VIF {"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface> {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface> {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Attempting to detach device tapc7efbdb0-e5 from instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] detach device xml: <interface type="ethernet">
Apr 17 10:40:07 user nova-compute[82522]:   <mac address="fa:16:3e:0e:ed:c9"/>
Apr 17 10:40:07 user nova-compute[82522]:   <model type="virtio"/>
Apr 17 10:40:07 user nova-compute[82522]:   <mtu size="1442"/>
Apr 17 10:40:07 user nova-compute[82522]:   <target dev="tapc7efbdb0-e5"/>
Apr 17 10:40:07 user nova-compute[82522]: </interface>
Apr 17 10:40:07 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface> {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface>not found in domain: <domain type='kvm' id='12'>
Apr 17 10:40:07 user nova-compute[82522]:   <name>instance-0000000c</name>
Apr 17 10:40:07 user nova-compute[82522]:   <uuid>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</uuid>
Apr 17 10:40:07 user nova-compute[82522]:   <metadata>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:40:07 user nova-compute[82522]:   <nova:package version="0.0.0"/>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:name>tempest-device-tagging-server-1840654553</nova:name>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:creationTime>2023-04-17 10:39:56</nova:creationTime>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:flavor name="m1.nano">
Apr 17 10:40:07 user nova-compute[82522]:     <nova:memory>128</nova:memory>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:disk>1</nova:disk>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:swap>0</nova:swap>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:vcpus>1</nova:vcpus>
Apr 17 10:40:07 user nova-compute[82522]:   </nova:flavor>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:owner>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:user uuid="ab512fbd85694415a5f7af8b689814d4">tempest-TaggedAttachmentsTest-1382963185-project-member</nova:user>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:project uuid="507228fb562e461e91a628829ce32d80">tempest-TaggedAttachmentsTest-1382963185</nova:project>
Apr 17 10:40:07 user nova-compute[82522]:   </nova:owner>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:ports>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:port uuid="3106e21d-664e-4c17-85be-f0a654c4eabc">
Apr 17 10:40:07 user nova-compute[82522]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:40:07 user nova-compute[82522]:     </nova:port>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:port uuid="c7efbdb0-e5e1-498a-890a-2f670253e25e">
Apr 17 10:40:07 user nova-compute[82522]:       <nova:ip type="fixed" address="10.10.10.236" ipVersion="4"/>
Apr 17 10:40:07 user nova-compute[82522]:     </nova:port>
Apr 17 10:40:07 user nova-compute[82522]:   </nova:ports>
Apr 17 10:40:07 user nova-compute[82522]: </nova:instance>
Apr 17 10:40:07 user nova-compute[82522]:   </metadata>
Apr 17 10:40:07 user nova-compute[82522]:   <memory unit='KiB'>131072</memory>
Apr 17 10:40:07 user nova-compute[82522]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 17 10:40:07 user nova-compute[82522]:   <vcpu placement='static'>1</vcpu>
Apr 17 10:40:07 user nova-compute[82522]:   <resource>
Apr 17 10:40:07 user nova-compute[82522]:     <partition>/machine</partition>
Apr 17 10:40:07 user nova-compute[82522]:   </resource>
Apr 17 10:40:07 user nova-compute[82522]:   <sysinfo type='smbios'>
Apr 17 10:40:07 user nova-compute[82522]:     <system>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='product'>OpenStack Nova</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='version'>0.0.0</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='serial'>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='uuid'>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='family'>Virtual Machine</entry>
Apr 17 10:40:07 user nova-compute[82522]:     </system>
Apr 17 10:40:07 user nova-compute[82522]:   </sysinfo>
Apr 17 10:40:07 user nova-compute[82522]:   <os>
Apr 17 10:40:07 user nova-compute[82522]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 17 10:40:07 user nova-compute[82522]:     <boot dev='hd'/>
Apr 17 10:40:07 user nova-compute[82522]:     <smbios mode='sysinfo'/>
Apr 17 10:40:07 user nova-compute[82522]:   </os>
Apr 17 10:40:07 user nova-compute[82522]:   <features>
Apr 17 10:40:07 user nova-compute[82522]:     <acpi/>
Apr 17 10:40:07 user nova-compute[82522]:     <apic/>
Apr 17 10:40:07 user nova-compute[82522]:     <vmcoreinfo state='on'/>
Apr 17 10:40:07 user nova-compute[82522]:   </features>
Apr 17 10:40:07 user nova-compute[82522]:   <cpu mode='custom' match='exact' check='full'>
Apr 17 10:40:07 user nova-compute[82522]:     <model fallback='forbid'>Nehalem</model>
Apr 17 10:40:07 user nova-compute[82522]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 17 10:40:07 user nova-compute[82522]:     <feature policy='require' name='vme'/>
Apr 17 10:40:07 user nova-compute[82522]:     <feature policy='require' name='x2apic'/>
Apr 17 10:40:07 user nova-compute[82522]:     <feature policy='require' name='hypervisor'/>
Apr 17 10:40:07 user nova-compute[82522]:   </cpu>
Apr 17 10:40:07 user nova-compute[82522]:   <clock offset='utc'>
Apr 17 10:40:07 user nova-compute[82522]:     <timer name='pit' tickpolicy='delay'/>
Apr 17 10:40:07 user nova-compute[82522]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 17 10:40:07 user nova-compute[82522]:     <timer name='hpet' present='no'/>
Apr 17 10:40:07 user nova-compute[82522]:   </clock>
Apr 17 10:40:07 user nova-compute[82522]:   <on_poweroff>destroy</on_poweroff>
Apr 17 10:40:07 user nova-compute[82522]:   <on_reboot>restart</on_reboot>
Apr 17 10:40:07 user nova-compute[82522]:   <on_crash>destroy</on_crash>
Apr 17 10:40:07 user nova-compute[82522]:   <devices>
Apr 17 10:40:07 user nova-compute[82522]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 17 10:40:07 user nova-compute[82522]:     <disk type='file' device='disk'>
Apr 17 10:40:07 user nova-compute[82522]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 17 10:40:07 user nova-compute[82522]:       <source file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk' index='2'/>
Apr 17 10:40:07 user nova-compute[82522]:       <backingStore type='file' index='3'>
Apr 17 10:40:07 user nova-compute[82522]:         <format type='raw'/>
Apr 17 10:40:07 user nova-compute[82522]:         <source file='/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853'/>
Apr 17 10:40:07 user nova-compute[82522]:         <backingStore/>
Apr 17 10:40:07 user nova-compute[82522]:       </backingStore>
Apr 17 10:40:07 user nova-compute[82522]:       <target dev='vda' bus='virtio'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='virtio-disk0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </disk>
Apr 17 10:40:07 user nova-compute[82522]:     <disk type='file' device='cdrom'>
Apr 17 10:40:07 user nova-compute[82522]:       <driver name='qemu' type='raw' cache='none'/>
Apr 17 10:40:07 user nova-compute[82522]:       <source file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.config' index='1'/>
Apr 17 10:40:07 user nova-compute[82522]:       <backingStore/>
Apr 17 10:40:07 user nova-compute[82522]:       <target dev='hda' bus='ide'/>
Apr 17 10:40:07 user nova-compute[82522]:       <readonly/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='ide0-0-0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </disk>
Apr 17 10:40:07 user nova-compute[82522]:     <controller type='usb' index='0' model='none'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='usb'/>
Apr 17 10:40:07 user nova-compute[82522]:     </controller>
Apr 17 10:40:07 user nova-compute[82522]:     <controller type='pci' index='0' model='pci-root'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='pci.0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </controller>
Apr 17 10:40:07 user nova-compute[82522]:     <controller type='ide' index='0'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='ide'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 17 10:40:07 user nova-compute[82522]:     </controller>
Apr 17 10:40:07 user nova-compute[82522]:     <interface type='ethernet'>
Apr 17 10:40:07 user nova-compute[82522]:       <mac address='fa:16:3e:b0:13:f7'/>
Apr 17 10:40:07 user nova-compute[82522]:       <target dev='tap3106e21d-66'/>
Apr 17 10:40:07 user nova-compute[82522]:       <model type='virtio'/>
Apr 17 10:40:07 user nova-compute[82522]:       <mtu size='1442'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='net0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </interface>
Apr 17 10:40:07 user nova-compute[82522]:     <interface type='ethernet'>
Apr 17 10:40:07 user nova-compute[82522]:       <mac address='fa:16:3e:0e:ed:c9'/>
Apr 17 10:40:07 user nova-compute[82522]:       <target dev='tapc7efbdb0-e5'/>
Apr 17 10:40:07 user nova-compute[82522]:       <model type='virtio'/>
Apr 17 10:40:07 user nova-compute[82522]:       <mtu size='1442'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='net1'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </interface>
Apr 17 10:40:07 user nova-compute[82522]:     <serial type='pty'>
Apr 17 10:40:07 user nova-compute[82522]:       <source path='/dev/pts/1'/>
Apr 17 10:40:07 user nova-compute[82522]:       <log file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log' append='off'/>
Apr 17 10:40:07 user nova-compute[82522]:       <target type='isa-serial' port='0'>
Apr 17 10:40:07 user nova-compute[82522]:         <model name='isa-serial'/>
Apr 17 10:40:07 user nova-compute[82522]:       </target>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='serial0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </serial>
Apr 17 10:40:07 user nova-compute[82522]:     <console type='pty' tty='/dev/pts/1'>
Apr 17 10:40:07 user nova-compute[82522]:       <source path='/dev/pts/1'/>
Apr 17 10:40:07 user nova-compute[82522]:       <log file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log' append='off'/>
Apr 17 10:40:07 user nova-compute[82522]:       <target type='serial' port='0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='serial0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </console>
Apr 17 10:40:07 user nova-compute[82522]:     <input type='mouse' bus='ps2'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='input0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </input>
Apr 17 10:40:07 user nova-compute[82522]:     <input type='keyboard' bus='ps2'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='input1'/>
Apr 17 10:40:07 user nova-compute[82522]:     </input>
Apr 17 10:40:07 user nova-compute[82522]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Apr 17 10:40:07 user nova-compute[82522]:       <listen type='address' address='0.0.0.0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </graphics>
Apr 17 10:40:07 user nova-compute[82522]:     <audio id='1' type='none'/>
Apr 17 10:40:07 user nova-compute[82522]:     <video>
Apr 17 10:40:07 user nova-compute[82522]:       <model type='virtio' heads='1' primary='yes'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='video0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </video>
Apr 17 10:40:07 user nova-compute[82522]:     <memballoon model='virtio'>
Apr 17 10:40:07 user nova-compute[82522]:       <stats period='10'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='balloon0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </memballoon>
Apr 17 10:40:07 user nova-compute[82522]:     <rng model='virtio'>
Apr 17 10:40:07 user nova-compute[82522]:       <backend model='random'>/dev/urandom</backend>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='rng0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </rng>
Apr 17 10:40:07 user nova-compute[82522]:   </devices>
Apr 17 10:40:07 user nova-compute[82522]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 17 10:40:07 user nova-compute[82522]:     <label>libvirt-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</label>
Apr 17 10:40:07 user nova-compute[82522]:     <imagelabel>libvirt-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</imagelabel>
Apr 17 10:40:07 user nova-compute[82522]:   </seclabel>
Apr 17 10:40:07 user nova-compute[82522]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 17 10:40:07 user nova-compute[82522]:     <label>+64055:+108</label>
Apr 17 10:40:07 user nova-compute[82522]:     <imagelabel>+64055:+108</imagelabel>
Apr 17 10:40:07 user nova-compute[82522]:   </seclabel>
Apr 17 10:40:07 user nova-compute[82522]: </domain>
Apr 17 10:40:07 user nova-compute[82522]:  {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 17 10:40:07 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Successfully detached device tapc7efbdb0-e5 from instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 from the persistent domain config.
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] (1/8): Attempting to detach device tapc7efbdb0-e5 with device alias net1 from instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] detach device xml: <interface type="ethernet">
Apr 17 10:40:07 user nova-compute[82522]:   <mac address="fa:16:3e:0e:ed:c9"/>
Apr 17 10:40:07 user nova-compute[82522]:   <model type="virtio"/>
Apr 17 10:40:07 user nova-compute[82522]:   <mtu size="1442"/>
Apr 17 10:40:07 user nova-compute[82522]:   <target dev="tapc7efbdb0-e5"/>
Apr 17 10:40:07 user nova-compute[82522]: </interface>
Apr 17 10:40:07 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728007.4371586, 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Start waiting for the detach event from libvirt for device tapc7efbdb0-e5 with device alias net1 for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface> {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface>not found in domain: <domain type='kvm' id='12'>
Apr 17 10:40:07 user nova-compute[82522]:   <name>instance-0000000c</name>
Apr 17 10:40:07 user nova-compute[82522]:   <uuid>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</uuid>
Apr 17 10:40:07 user nova-compute[82522]:   <metadata>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:40:07 user nova-compute[82522]:   <nova:package version="0.0.0"/>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:name>tempest-device-tagging-server-1840654553</nova:name>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:creationTime>2023-04-17 10:39:56</nova:creationTime>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:flavor name="m1.nano">
Apr 17 10:40:07 user nova-compute[82522]:     <nova:memory>128</nova:memory>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:disk>1</nova:disk>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:swap>0</nova:swap>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:vcpus>1</nova:vcpus>
Apr 17 10:40:07 user nova-compute[82522]:   </nova:flavor>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:owner>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:user uuid="ab512fbd85694415a5f7af8b689814d4">tempest-TaggedAttachmentsTest-1382963185-project-member</nova:user>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:project uuid="507228fb562e461e91a628829ce32d80">tempest-TaggedAttachmentsTest-1382963185</nova:project>
Apr 17 10:40:07 user nova-compute[82522]:   </nova:owner>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:ports>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:port uuid="3106e21d-664e-4c17-85be-f0a654c4eabc">
Apr 17 10:40:07 user nova-compute[82522]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:40:07 user nova-compute[82522]:     </nova:port>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:port uuid="c7efbdb0-e5e1-498a-890a-2f670253e25e">
Apr 17 10:40:07 user nova-compute[82522]:       <nova:ip type="fixed" address="10.10.10.236" ipVersion="4"/>
Apr 17 10:40:07 user nova-compute[82522]:     </nova:port>
Apr 17 10:40:07 user nova-compute[82522]:   </nova:ports>
Apr 17 10:40:07 user nova-compute[82522]: </nova:instance>
Apr 17 10:40:07 user nova-compute[82522]:   </metadata>
Apr 17 10:40:07 user nova-compute[82522]:   <memory unit='KiB'>131072</memory>
Apr 17 10:40:07 user nova-compute[82522]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 17 10:40:07 user nova-compute[82522]:   <vcpu placement='static'>1</vcpu>
Apr 17 10:40:07 user nova-compute[82522]:   <resource>
Apr 17 10:40:07 user nova-compute[82522]:     <partition>/machine</partition>
Apr 17 10:40:07 user nova-compute[82522]:   </resource>
Apr 17 10:40:07 user nova-compute[82522]:   <sysinfo type='smbios'>
Apr 17 10:40:07 user nova-compute[82522]:     <system>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='product'>OpenStack Nova</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='version'>0.0.0</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='serial'>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='uuid'>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:40:07 user nova-compute[82522]:       <entry name='family'>Virtual Machine</entry>
Apr 17 10:40:07 user nova-compute[82522]:     </system>
Apr 17 10:40:07 user nova-compute[82522]:   </sysinfo>
Apr 17 10:40:07 user nova-compute[82522]:   <os>
Apr 17 10:40:07 user nova-compute[82522]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 17 10:40:07 user nova-compute[82522]:     <boot dev='hd'/>
Apr 17 10:40:07 user nova-compute[82522]:     <smbios mode='sysinfo'/>
Apr 17 10:40:07 user nova-compute[82522]:   </os>
Apr 17 10:40:07 user nova-compute[82522]:   <features>
Apr 17 10:40:07 user nova-compute[82522]:     <acpi/>
Apr 17 10:40:07 user nova-compute[82522]:     <apic/>
Apr 17 10:40:07 user nova-compute[82522]:     <vmcoreinfo state='on'/>
Apr 17 10:40:07 user nova-compute[82522]:   </features>
Apr 17 10:40:07 user nova-compute[82522]:   <cpu mode='custom' match='exact' check='full'>
Apr 17 10:40:07 user nova-compute[82522]:     <model fallback='forbid'>Nehalem</model>
Apr 17 10:40:07 user nova-compute[82522]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 17 10:40:07 user nova-compute[82522]:     <feature policy='require' name='vme'/>
Apr 17 10:40:07 user nova-compute[82522]:     <feature policy='require' name='x2apic'/>
Apr 17 10:40:07 user nova-compute[82522]:     <feature policy='require' name='hypervisor'/>
Apr 17 10:40:07 user nova-compute[82522]:   </cpu>
Apr 17 10:40:07 user nova-compute[82522]:   <clock offset='utc'>
Apr 17 10:40:07 user nova-compute[82522]:     <timer name='pit' tickpolicy='delay'/>
Apr 17 10:40:07 user nova-compute[82522]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 17 10:40:07 user nova-compute[82522]:     <timer name='hpet' present='no'/>
Apr 17 10:40:07 user nova-compute[82522]:   </clock>
Apr 17 10:40:07 user nova-compute[82522]:   <on_poweroff>destroy</on_poweroff>
Apr 17 10:40:07 user nova-compute[82522]:   <on_reboot>restart</on_reboot>
Apr 17 10:40:07 user nova-compute[82522]:   <on_crash>destroy</on_crash>
Apr 17 10:40:07 user nova-compute[82522]:   <devices>
Apr 17 10:40:07 user nova-compute[82522]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 17 10:40:07 user nova-compute[82522]:     <disk type='file' device='disk'>
Apr 17 10:40:07 user nova-compute[82522]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 17 10:40:07 user nova-compute[82522]:       <source file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk' index='2'/>
Apr 17 10:40:07 user nova-compute[82522]:       <backingStore type='file' index='3'>
Apr 17 10:40:07 user nova-compute[82522]:         <format type='raw'/>
Apr 17 10:40:07 user nova-compute[82522]:         <source file='/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853'/>
Apr 17 10:40:07 user nova-compute[82522]:         <backingStore/>
Apr 17 10:40:07 user nova-compute[82522]:       </backingStore>
Apr 17 10:40:07 user nova-compute[82522]:       <target dev='vda' bus='virtio'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='virtio-disk0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </disk>
Apr 17 10:40:07 user nova-compute[82522]:     <disk type='file' device='cdrom'>
Apr 17 10:40:07 user nova-compute[82522]:       <driver name='qemu' type='raw' cache='none'/>
Apr 17 10:40:07 user nova-compute[82522]:       <source file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.config' index='1'/>
Apr 17 10:40:07 user nova-compute[82522]:       <backingStore/>
Apr 17 10:40:07 user nova-compute[82522]:       <target dev='hda' bus='ide'/>
Apr 17 10:40:07 user nova-compute[82522]:       <readonly/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='ide0-0-0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </disk>
Apr 17 10:40:07 user nova-compute[82522]:     <controller type='usb' index='0' model='none'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='usb'/>
Apr 17 10:40:07 user nova-compute[82522]:     </controller>
Apr 17 10:40:07 user nova-compute[82522]:     <controller type='pci' index='0' model='pci-root'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='pci.0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </controller>
Apr 17 10:40:07 user nova-compute[82522]:     <controller type='ide' index='0'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='ide'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 17 10:40:07 user nova-compute[82522]:     </controller>
Apr 17 10:40:07 user nova-compute[82522]:     <interface type='ethernet'>
Apr 17 10:40:07 user nova-compute[82522]:       <mac address='fa:16:3e:b0:13:f7'/>
Apr 17 10:40:07 user nova-compute[82522]:       <target dev='tap3106e21d-66'/>
Apr 17 10:40:07 user nova-compute[82522]:       <model type='virtio'/>
Apr 17 10:40:07 user nova-compute[82522]:       <mtu size='1442'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='net0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </interface>
Apr 17 10:40:07 user nova-compute[82522]:     <serial type='pty'>
Apr 17 10:40:07 user nova-compute[82522]:       <source path='/dev/pts/1'/>
Apr 17 10:40:07 user nova-compute[82522]:       <log file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log' append='off'/>
Apr 17 10:40:07 user nova-compute[82522]:       <target type='isa-serial' port='0'>
Apr 17 10:40:07 user nova-compute[82522]:         <model name='isa-serial'/>
Apr 17 10:40:07 user nova-compute[82522]:       </target>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='serial0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </serial>
Apr 17 10:40:07 user nova-compute[82522]:     <console type='pty' tty='/dev/pts/1'>
Apr 17 10:40:07 user nova-compute[82522]:       <source path='/dev/pts/1'/>
Apr 17 10:40:07 user nova-compute[82522]:       <log file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log' append='off'/>
Apr 17 10:40:07 user nova-compute[82522]:       <target type='serial' port='0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='serial0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </console>
Apr 17 10:40:07 user nova-compute[82522]:     <input type='mouse' bus='ps2'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='input0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </input>
Apr 17 10:40:07 user nova-compute[82522]:     <input type='keyboard' bus='ps2'>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='input1'/>
Apr 17 10:40:07 user nova-compute[82522]:     </input>
Apr 17 10:40:07 user nova-compute[82522]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Apr 17 10:40:07 user nova-compute[82522]:       <listen type='address' address='0.0.0.0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </graphics>
Apr 17 10:40:07 user nova-compute[82522]:     <audio id='1' type='none'/>
Apr 17 10:40:07 user nova-compute[82522]:     <video>
Apr 17 10:40:07 user nova-compute[82522]:       <model type='virtio' heads='1' primary='yes'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='video0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </video>
Apr 17 10:40:07 user nova-compute[82522]:     <memballoon model='virtio'>
Apr 17 10:40:07 user nova-compute[82522]:       <stats period='10'/>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='balloon0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </memballoon>
Apr 17 10:40:07 user nova-compute[82522]:     <rng model='virtio'>
Apr 17 10:40:07 user nova-compute[82522]:       <backend model='random'>/dev/urandom</backend>
Apr 17 10:40:07 user nova-compute[82522]:       <alias name='rng0'/>
Apr 17 10:40:07 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 17 10:40:07 user nova-compute[82522]:     </rng>
Apr 17 10:40:07 user nova-compute[82522]:   </devices>
Apr 17 10:40:07 user nova-compute[82522]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 17 10:40:07 user nova-compute[82522]:     <label>libvirt-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</label>
Apr 17 10:40:07 user nova-compute[82522]:     <imagelabel>libvirt-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</imagelabel>
Apr 17 10:40:07 user nova-compute[82522]:   </seclabel>
Apr 17 10:40:07 user nova-compute[82522]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 17 10:40:07 user nova-compute[82522]:     <label>+64055:+108</label>
Apr 17 10:40:07 user nova-compute[82522]:     <imagelabel>+64055:+108</imagelabel>
Apr 17 10:40:07 user nova-compute[82522]:   </seclabel>
Apr 17 10:40:07 user nova-compute[82522]: </domain>
Apr 17 10:40:07 user nova-compute[82522]:  {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 17 10:40:07 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Successfully detached device tapc7efbdb0-e5 from instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 from the live domain config.
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1840654553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1840654553',id=12,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA==',key_name='tempest-keypair-1227280417',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='507228fb562e461e91a628829ce32d80',ramdisk_id='',reservation_id='r-fakqiiql',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382963185',owner_user_name='tempest-TaggedAttachmentsTest-1382963185-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab512fbd85694415a5f7af8b689814d4',uuid=9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converting VIF {"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG os_vif [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7efbdb0-e5, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:07 user nova-compute[82522]: INFO os_vif [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5')
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:40:07 user nova-compute[82522]:   <nova:package version="0.0.0"/>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:name>tempest-device-tagging-server-1840654553</nova:name>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:creationTime>2023-04-17 10:40:07</nova:creationTime>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:flavor name="m1.nano">
Apr 17 10:40:07 user nova-compute[82522]:     <nova:memory>128</nova:memory>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:disk>1</nova:disk>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:swap>0</nova:swap>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:vcpus>1</nova:vcpus>
Apr 17 10:40:07 user nova-compute[82522]:   </nova:flavor>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:owner>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:user uuid="ab512fbd85694415a5f7af8b689814d4">tempest-TaggedAttachmentsTest-1382963185-project-member</nova:user>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:project uuid="507228fb562e461e91a628829ce32d80">tempest-TaggedAttachmentsTest-1382963185</nova:project>
Apr 17 10:40:07 user nova-compute[82522]:   </nova:owner>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:40:07 user nova-compute[82522]:   <nova:ports>
Apr 17 10:40:07 user nova-compute[82522]:     <nova:port uuid="3106e21d-664e-4c17-85be-f0a654c4eabc">
Apr 17 10:40:07 user nova-compute[82522]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:40:07 user nova-compute[82522]:     </nova:port>
Apr 17 10:40:07 user nova-compute[82522]:   </nova:ports>
Apr 17 10:40:07 user nova-compute[82522]: </nova:instance>
Apr 17 10:40:07 user nova-compute[82522]:  {{(pid=82522) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-unplugged-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] No waiting events found dispatching network-vif-unplugged-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:07 user nova-compute[82522]: WARNING nova.compute.manager [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received unexpected event network-vif-unplugged-c7efbdb0-e5e1-498a-890a-2f670253e25e for instance with vm_state active and task_state None.
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-deleted-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:07 user nova-compute[82522]: INFO nova.compute.manager [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Neutron deleted interface c7efbdb0-e5e1-498a-890a-2f670253e25e; detaching it from the instance and deleting it from the info cache
Apr 17 10:40:07 user nova-compute[82522]: DEBUG nova.network.neutron [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updating instance_info_cache with network_info: [{"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquired lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.network.neutron [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.objects.instance [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Lazy-loading 'system_metadata' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.objects.instance [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Lazy-loading 'flavor' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1840654553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1840654553',id=12,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA==',key_name='tempest-keypair-1227280417',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='507228fb562e461e91a628829ce32d80',ramdisk_id='',reservation_id='r-fakqiiql',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382963185',owner_user_name='tempest-TaggedAttachmentsTest-1382963185-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab512fbd85694415a5f7af8b689814d4',uuid=9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Converting VIF {"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface> {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface>not found in domain: <domain type='kvm' id='12'>
Apr 17 10:40:08 user nova-compute[82522]:   <name>instance-0000000c</name>
Apr 17 10:40:08 user nova-compute[82522]:   <uuid>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</uuid>
Apr 17 10:40:08 user nova-compute[82522]:   <metadata>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:40:08 user nova-compute[82522]:   <nova:package version="0.0.0"/>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:name>tempest-device-tagging-server-1840654553</nova:name>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:creationTime>2023-04-17 10:40:07</nova:creationTime>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:flavor name="m1.nano">
Apr 17 10:40:08 user nova-compute[82522]:     <nova:memory>128</nova:memory>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:disk>1</nova:disk>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:swap>0</nova:swap>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:vcpus>1</nova:vcpus>
Apr 17 10:40:08 user nova-compute[82522]:   </nova:flavor>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:owner>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:user uuid="ab512fbd85694415a5f7af8b689814d4">tempest-TaggedAttachmentsTest-1382963185-project-member</nova:user>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:project uuid="507228fb562e461e91a628829ce32d80">tempest-TaggedAttachmentsTest-1382963185</nova:project>
Apr 17 10:40:08 user nova-compute[82522]:   </nova:owner>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:ports>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:port uuid="3106e21d-664e-4c17-85be-f0a654c4eabc">
Apr 17 10:40:08 user nova-compute[82522]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:40:08 user nova-compute[82522]:     </nova:port>
Apr 17 10:40:08 user nova-compute[82522]:   </nova:ports>
Apr 17 10:40:08 user nova-compute[82522]: </nova:instance>
Apr 17 10:40:08 user nova-compute[82522]:   </metadata>
Apr 17 10:40:08 user nova-compute[82522]:   <memory unit='KiB'>131072</memory>
Apr 17 10:40:08 user nova-compute[82522]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 17 10:40:08 user nova-compute[82522]:   <vcpu placement='static'>1</vcpu>
Apr 17 10:40:08 user nova-compute[82522]:   <resource>
Apr 17 10:40:08 user nova-compute[82522]:     <partition>/machine</partition>
Apr 17 10:40:08 user nova-compute[82522]:   </resource>
Apr 17 10:40:08 user nova-compute[82522]:   <sysinfo type='smbios'>
Apr 17 10:40:08 user nova-compute[82522]:     <system>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='product'>OpenStack Nova</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='version'>0.0.0</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='serial'>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='uuid'>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='family'>Virtual Machine</entry>
Apr 17 10:40:08 user nova-compute[82522]:     </system>
Apr 17 10:40:08 user nova-compute[82522]:   </sysinfo>
Apr 17 10:40:08 user nova-compute[82522]:   <os>
Apr 17 10:40:08 user nova-compute[82522]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 17 10:40:08 user nova-compute[82522]:     <boot dev='hd'/>
Apr 17 10:40:08 user nova-compute[82522]:     <smbios mode='sysinfo'/>
Apr 17 10:40:08 user nova-compute[82522]:   </os>
Apr 17 10:40:08 user nova-compute[82522]:   <features>
Apr 17 10:40:08 user nova-compute[82522]:     <acpi/>
Apr 17 10:40:08 user nova-compute[82522]:     <apic/>
Apr 17 10:40:08 user nova-compute[82522]:     <vmcoreinfo state='on'/>
Apr 17 10:40:08 user nova-compute[82522]:   </features>
Apr 17 10:40:08 user nova-compute[82522]:   <cpu mode='custom' match='exact' check='full'>
Apr 17 10:40:08 user nova-compute[82522]:     <model fallback='forbid'>Nehalem</model>
Apr 17 10:40:08 user nova-compute[82522]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 17 10:40:08 user nova-compute[82522]:     <feature policy='require' name='vme'/>
Apr 17 10:40:08 user nova-compute[82522]:     <feature policy='require' name='x2apic'/>
Apr 17 10:40:08 user nova-compute[82522]:     <feature policy='require' name='hypervisor'/>
Apr 17 10:40:08 user nova-compute[82522]:   </cpu>
Apr 17 10:40:08 user nova-compute[82522]:   <clock offset='utc'>
Apr 17 10:40:08 user nova-compute[82522]:     <timer name='pit' tickpolicy='delay'/>
Apr 17 10:40:08 user nova-compute[82522]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 17 10:40:08 user nova-compute[82522]:     <timer name='hpet' present='no'/>
Apr 17 10:40:08 user nova-compute[82522]:   </clock>
Apr 17 10:40:08 user nova-compute[82522]:   <on_poweroff>destroy</on_poweroff>
Apr 17 10:40:08 user nova-compute[82522]:   <on_reboot>restart</on_reboot>
Apr 17 10:40:08 user nova-compute[82522]:   <on_crash>destroy</on_crash>
Apr 17 10:40:08 user nova-compute[82522]:   <devices>
Apr 17 10:40:08 user nova-compute[82522]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 17 10:40:08 user nova-compute[82522]:     <disk type='file' device='disk'>
Apr 17 10:40:08 user nova-compute[82522]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 17 10:40:08 user nova-compute[82522]:       <source file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk' index='2'/>
Apr 17 10:40:08 user nova-compute[82522]:       <backingStore type='file' index='3'>
Apr 17 10:40:08 user nova-compute[82522]:         <format type='raw'/>
Apr 17 10:40:08 user nova-compute[82522]:         <source file='/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853'/>
Apr 17 10:40:08 user nova-compute[82522]:         <backingStore/>
Apr 17 10:40:08 user nova-compute[82522]:       </backingStore>
Apr 17 10:40:08 user nova-compute[82522]:       <target dev='vda' bus='virtio'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='virtio-disk0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </disk>
Apr 17 10:40:08 user nova-compute[82522]:     <disk type='file' device='cdrom'>
Apr 17 10:40:08 user nova-compute[82522]:       <driver name='qemu' type='raw' cache='none'/>
Apr 17 10:40:08 user nova-compute[82522]:       <source file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.config' index='1'/>
Apr 17 10:40:08 user nova-compute[82522]:       <backingStore/>
Apr 17 10:40:08 user nova-compute[82522]:       <target dev='hda' bus='ide'/>
Apr 17 10:40:08 user nova-compute[82522]:       <readonly/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='ide0-0-0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </disk>
Apr 17 10:40:08 user nova-compute[82522]:     <controller type='usb' index='0' model='none'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='usb'/>
Apr 17 10:40:08 user nova-compute[82522]:     </controller>
Apr 17 10:40:08 user nova-compute[82522]:     <controller type='pci' index='0' model='pci-root'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='pci.0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </controller>
Apr 17 10:40:08 user nova-compute[82522]:     <controller type='ide' index='0'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='ide'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 17 10:40:08 user nova-compute[82522]:     </controller>
Apr 17 10:40:08 user nova-compute[82522]:     <interface type='ethernet'>
Apr 17 10:40:08 user nova-compute[82522]:       <mac address='fa:16:3e:b0:13:f7'/>
Apr 17 10:40:08 user nova-compute[82522]:       <target dev='tap3106e21d-66'/>
Apr 17 10:40:08 user nova-compute[82522]:       <model type='virtio'/>
Apr 17 10:40:08 user nova-compute[82522]:       <mtu size='1442'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='net0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </interface>
Apr 17 10:40:08 user nova-compute[82522]:     <serial type='pty'>
Apr 17 10:40:08 user nova-compute[82522]:       <source path='/dev/pts/1'/>
Apr 17 10:40:08 user nova-compute[82522]:       <log file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log' append='off'/>
Apr 17 10:40:08 user nova-compute[82522]:       <target type='isa-serial' port='0'>
Apr 17 10:40:08 user nova-compute[82522]:         <model name='isa-serial'/>
Apr 17 10:40:08 user nova-compute[82522]:       </target>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='serial0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </serial>
Apr 17 10:40:08 user nova-compute[82522]:     <console type='pty' tty='/dev/pts/1'>
Apr 17 10:40:08 user nova-compute[82522]:       <source path='/dev/pts/1'/>
Apr 17 10:40:08 user nova-compute[82522]:       <log file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log' append='off'/>
Apr 17 10:40:08 user nova-compute[82522]:       <target type='serial' port='0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='serial0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </console>
Apr 17 10:40:08 user nova-compute[82522]:     <input type='mouse' bus='ps2'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='input0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </input>
Apr 17 10:40:08 user nova-compute[82522]:     <input type='keyboard' bus='ps2'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='input1'/>
Apr 17 10:40:08 user nova-compute[82522]:     </input>
Apr 17 10:40:08 user nova-compute[82522]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Apr 17 10:40:08 user nova-compute[82522]:       <listen type='address' address='0.0.0.0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </graphics>
Apr 17 10:40:08 user nova-compute[82522]:     <audio id='1' type='none'/>
Apr 17 10:40:08 user nova-compute[82522]:     <video>
Apr 17 10:40:08 user nova-compute[82522]:       <model type='virtio' heads='1' primary='yes'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='video0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </video>
Apr 17 10:40:08 user nova-compute[82522]:     <memballoon model='virtio'>
Apr 17 10:40:08 user nova-compute[82522]:       <stats period='10'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='balloon0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </memballoon>
Apr 17 10:40:08 user nova-compute[82522]:     <rng model='virtio'>
Apr 17 10:40:08 user nova-compute[82522]:       <backend model='random'>/dev/urandom</backend>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='rng0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </rng>
Apr 17 10:40:08 user nova-compute[82522]:   </devices>
Apr 17 10:40:08 user nova-compute[82522]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 17 10:40:08 user nova-compute[82522]:     <label>libvirt-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</label>
Apr 17 10:40:08 user nova-compute[82522]:     <imagelabel>libvirt-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</imagelabel>
Apr 17 10:40:08 user nova-compute[82522]:   </seclabel>
Apr 17 10:40:08 user nova-compute[82522]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 17 10:40:08 user nova-compute[82522]:     <label>+64055:+108</label>
Apr 17 10:40:08 user nova-compute[82522]:     <imagelabel>+64055:+108</imagelabel>
Apr 17 10:40:08 user nova-compute[82522]:   </seclabel>
Apr 17 10:40:08 user nova-compute[82522]: </domain>
Apr 17 10:40:08 user nova-compute[82522]:  {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface> {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:ed:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tapc7efbdb0-e5"/></interface>not found in domain: <domain type='kvm' id='12'>
Apr 17 10:40:08 user nova-compute[82522]:   <name>instance-0000000c</name>
Apr 17 10:40:08 user nova-compute[82522]:   <uuid>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</uuid>
Apr 17 10:40:08 user nova-compute[82522]:   <metadata>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:40:08 user nova-compute[82522]:   <nova:package version="0.0.0"/>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:name>tempest-device-tagging-server-1840654553</nova:name>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:creationTime>2023-04-17 10:40:07</nova:creationTime>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:flavor name="m1.nano">
Apr 17 10:40:08 user nova-compute[82522]:     <nova:memory>128</nova:memory>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:disk>1</nova:disk>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:swap>0</nova:swap>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:vcpus>1</nova:vcpus>
Apr 17 10:40:08 user nova-compute[82522]:   </nova:flavor>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:owner>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:user uuid="ab512fbd85694415a5f7af8b689814d4">tempest-TaggedAttachmentsTest-1382963185-project-member</nova:user>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:project uuid="507228fb562e461e91a628829ce32d80">tempest-TaggedAttachmentsTest-1382963185</nova:project>
Apr 17 10:40:08 user nova-compute[82522]:   </nova:owner>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:ports>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:port uuid="3106e21d-664e-4c17-85be-f0a654c4eabc">
Apr 17 10:40:08 user nova-compute[82522]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:40:08 user nova-compute[82522]:     </nova:port>
Apr 17 10:40:08 user nova-compute[82522]:   </nova:ports>
Apr 17 10:40:08 user nova-compute[82522]: </nova:instance>
Apr 17 10:40:08 user nova-compute[82522]:   </metadata>
Apr 17 10:40:08 user nova-compute[82522]:   <memory unit='KiB'>131072</memory>
Apr 17 10:40:08 user nova-compute[82522]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 17 10:40:08 user nova-compute[82522]:   <vcpu placement='static'>1</vcpu>
Apr 17 10:40:08 user nova-compute[82522]:   <resource>
Apr 17 10:40:08 user nova-compute[82522]:     <partition>/machine</partition>
Apr 17 10:40:08 user nova-compute[82522]:   </resource>
Apr 17 10:40:08 user nova-compute[82522]:   <sysinfo type='smbios'>
Apr 17 10:40:08 user nova-compute[82522]:     <system>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='product'>OpenStack Nova</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='version'>0.0.0</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='serial'>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='uuid'>9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</entry>
Apr 17 10:40:08 user nova-compute[82522]:       <entry name='family'>Virtual Machine</entry>
Apr 17 10:40:08 user nova-compute[82522]:     </system>
Apr 17 10:40:08 user nova-compute[82522]:   </sysinfo>
Apr 17 10:40:08 user nova-compute[82522]:   <os>
Apr 17 10:40:08 user nova-compute[82522]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 17 10:40:08 user nova-compute[82522]:     <boot dev='hd'/>
Apr 17 10:40:08 user nova-compute[82522]:     <smbios mode='sysinfo'/>
Apr 17 10:40:08 user nova-compute[82522]:   </os>
Apr 17 10:40:08 user nova-compute[82522]:   <features>
Apr 17 10:40:08 user nova-compute[82522]:     <acpi/>
Apr 17 10:40:08 user nova-compute[82522]:     <apic/>
Apr 17 10:40:08 user nova-compute[82522]:     <vmcoreinfo state='on'/>
Apr 17 10:40:08 user nova-compute[82522]:   </features>
Apr 17 10:40:08 user nova-compute[82522]:   <cpu mode='custom' match='exact' check='full'>
Apr 17 10:40:08 user nova-compute[82522]:     <model fallback='forbid'>Nehalem</model>
Apr 17 10:40:08 user nova-compute[82522]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 17 10:40:08 user nova-compute[82522]:     <feature policy='require' name='vme'/>
Apr 17 10:40:08 user nova-compute[82522]:     <feature policy='require' name='x2apic'/>
Apr 17 10:40:08 user nova-compute[82522]:     <feature policy='require' name='hypervisor'/>
Apr 17 10:40:08 user nova-compute[82522]:   </cpu>
Apr 17 10:40:08 user nova-compute[82522]:   <clock offset='utc'>
Apr 17 10:40:08 user nova-compute[82522]:     <timer name='pit' tickpolicy='delay'/>
Apr 17 10:40:08 user nova-compute[82522]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 17 10:40:08 user nova-compute[82522]:     <timer name='hpet' present='no'/>
Apr 17 10:40:08 user nova-compute[82522]:   </clock>
Apr 17 10:40:08 user nova-compute[82522]:   <on_poweroff>destroy</on_poweroff>
Apr 17 10:40:08 user nova-compute[82522]:   <on_reboot>restart</on_reboot>
Apr 17 10:40:08 user nova-compute[82522]:   <on_crash>destroy</on_crash>
Apr 17 10:40:08 user nova-compute[82522]:   <devices>
Apr 17 10:40:08 user nova-compute[82522]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 17 10:40:08 user nova-compute[82522]:     <disk type='file' device='disk'>
Apr 17 10:40:08 user nova-compute[82522]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 17 10:40:08 user nova-compute[82522]:       <source file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk' index='2'/>
Apr 17 10:40:08 user nova-compute[82522]:       <backingStore type='file' index='3'>
Apr 17 10:40:08 user nova-compute[82522]:         <format type='raw'/>
Apr 17 10:40:08 user nova-compute[82522]:         <source file='/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853'/>
Apr 17 10:40:08 user nova-compute[82522]:         <backingStore/>
Apr 17 10:40:08 user nova-compute[82522]:       </backingStore>
Apr 17 10:40:08 user nova-compute[82522]:       <target dev='vda' bus='virtio'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='virtio-disk0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </disk>
Apr 17 10:40:08 user nova-compute[82522]:     <disk type='file' device='cdrom'>
Apr 17 10:40:08 user nova-compute[82522]:       <driver name='qemu' type='raw' cache='none'/>
Apr 17 10:40:08 user nova-compute[82522]:       <source file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk.config' index='1'/>
Apr 17 10:40:08 user nova-compute[82522]:       <backingStore/>
Apr 17 10:40:08 user nova-compute[82522]:       <target dev='hda' bus='ide'/>
Apr 17 10:40:08 user nova-compute[82522]:       <readonly/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='ide0-0-0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </disk>
Apr 17 10:40:08 user nova-compute[82522]:     <controller type='usb' index='0' model='none'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='usb'/>
Apr 17 10:40:08 user nova-compute[82522]:     </controller>
Apr 17 10:40:08 user nova-compute[82522]:     <controller type='pci' index='0' model='pci-root'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='pci.0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </controller>
Apr 17 10:40:08 user nova-compute[82522]:     <controller type='ide' index='0'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='ide'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 17 10:40:08 user nova-compute[82522]:     </controller>
Apr 17 10:40:08 user nova-compute[82522]:     <interface type='ethernet'>
Apr 17 10:40:08 user nova-compute[82522]:       <mac address='fa:16:3e:b0:13:f7'/>
Apr 17 10:40:08 user nova-compute[82522]:       <target dev='tap3106e21d-66'/>
Apr 17 10:40:08 user nova-compute[82522]:       <model type='virtio'/>
Apr 17 10:40:08 user nova-compute[82522]:       <mtu size='1442'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='net0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </interface>
Apr 17 10:40:08 user nova-compute[82522]:     <serial type='pty'>
Apr 17 10:40:08 user nova-compute[82522]:       <source path='/dev/pts/1'/>
Apr 17 10:40:08 user nova-compute[82522]:       <log file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log' append='off'/>
Apr 17 10:40:08 user nova-compute[82522]:       <target type='isa-serial' port='0'>
Apr 17 10:40:08 user nova-compute[82522]:         <model name='isa-serial'/>
Apr 17 10:40:08 user nova-compute[82522]:       </target>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='serial0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </serial>
Apr 17 10:40:08 user nova-compute[82522]:     <console type='pty' tty='/dev/pts/1'>
Apr 17 10:40:08 user nova-compute[82522]:       <source path='/dev/pts/1'/>
Apr 17 10:40:08 user nova-compute[82522]:       <log file='/opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/console.log' append='off'/>
Apr 17 10:40:08 user nova-compute[82522]:       <target type='serial' port='0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='serial0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </console>
Apr 17 10:40:08 user nova-compute[82522]:     <input type='mouse' bus='ps2'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='input0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </input>
Apr 17 10:40:08 user nova-compute[82522]:     <input type='keyboard' bus='ps2'>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='input1'/>
Apr 17 10:40:08 user nova-compute[82522]:     </input>
Apr 17 10:40:08 user nova-compute[82522]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Apr 17 10:40:08 user nova-compute[82522]:       <listen type='address' address='0.0.0.0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </graphics>
Apr 17 10:40:08 user nova-compute[82522]:     <audio id='1' type='none'/>
Apr 17 10:40:08 user nova-compute[82522]:     <video>
Apr 17 10:40:08 user nova-compute[82522]:       <model type='virtio' heads='1' primary='yes'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='video0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </video>
Apr 17 10:40:08 user nova-compute[82522]:     <memballoon model='virtio'>
Apr 17 10:40:08 user nova-compute[82522]:       <stats period='10'/>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='balloon0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </memballoon>
Apr 17 10:40:08 user nova-compute[82522]:     <rng model='virtio'>
Apr 17 10:40:08 user nova-compute[82522]:       <backend model='random'>/dev/urandom</backend>
Apr 17 10:40:08 user nova-compute[82522]:       <alias name='rng0'/>
Apr 17 10:40:08 user nova-compute[82522]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 17 10:40:08 user nova-compute[82522]:     </rng>
Apr 17 10:40:08 user nova-compute[82522]:   </devices>
Apr 17 10:40:08 user nova-compute[82522]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 17 10:40:08 user nova-compute[82522]:     <label>libvirt-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</label>
Apr 17 10:40:08 user nova-compute[82522]:     <imagelabel>libvirt-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597</imagelabel>
Apr 17 10:40:08 user nova-compute[82522]:   </seclabel>
Apr 17 10:40:08 user nova-compute[82522]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 17 10:40:08 user nova-compute[82522]:     <label>+64055:+108</label>
Apr 17 10:40:08 user nova-compute[82522]:     <imagelabel>+64055:+108</imagelabel>
Apr 17 10:40:08 user nova-compute[82522]:   </seclabel>
Apr 17 10:40:08 user nova-compute[82522]: </domain>
Apr 17 10:40:08 user nova-compute[82522]:  {{(pid=82522) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 17 10:40:08 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Detaching interface fa:16:3e:0e:ed:c9 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapc7efbdb0-e5' not found.
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1840654553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1840654553',id=12,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA==',key_name='tempest-keypair-1227280417',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='507228fb562e461e91a628829ce32d80',ramdisk_id='',reservation_id='r-fakqiiql',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382963185',owner_user_name='tempest-TaggedAttachmentsTest-1382963185-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab512fbd85694415a5f7af8b689814d4',uuid=9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Converting VIF {"id": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "address": "fa:16:3e:0e:ed:c9", "network": {"id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-59373928", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7efbdb0-e5", "ovs_interfaceid": "c7efbdb0-e5e1-498a-890a-2f670253e25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG os_vif [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7efbdb0-e5, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:40:08 user nova-compute[82522]: INFO os_vif [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ed:c9,bridge_name='br-int',has_traffic_filtering=True,id=c7efbdb0-e5e1-498a-890a-2f670253e25e,network=Network(80a7eb54-0ff4-48d7-a4dd-0daaf77a868f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7efbdb0-e5')
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:40:08 user nova-compute[82522]:   <nova:package version="0.0.0"/>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:name>tempest-device-tagging-server-1840654553</nova:name>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:creationTime>2023-04-17 10:40:08</nova:creationTime>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:flavor name="m1.nano">
Apr 17 10:40:08 user nova-compute[82522]:     <nova:memory>128</nova:memory>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:disk>1</nova:disk>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:swap>0</nova:swap>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:vcpus>1</nova:vcpus>
Apr 17 10:40:08 user nova-compute[82522]:   </nova:flavor>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:owner>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:user uuid="ab512fbd85694415a5f7af8b689814d4">tempest-TaggedAttachmentsTest-1382963185-project-member</nova:user>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:project uuid="507228fb562e461e91a628829ce32d80">tempest-TaggedAttachmentsTest-1382963185</nova:project>
Apr 17 10:40:08 user nova-compute[82522]:   </nova:owner>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:40:08 user nova-compute[82522]:   <nova:ports>
Apr 17 10:40:08 user nova-compute[82522]:     <nova:port uuid="3106e21d-664e-4c17-85be-f0a654c4eabc">
Apr 17 10:40:08 user nova-compute[82522]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:40:08 user nova-compute[82522]:     </nova:port>
Apr 17 10:40:08 user nova-compute[82522]:   </nova:ports>
Apr 17 10:40:08 user nova-compute[82522]: </nova:instance>
Apr 17 10:40:08 user nova-compute[82522]:  {{(pid=82522) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG nova.network.neutron [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updating instance_info_cache with network_info: [{"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Releasing lock "refresh_cache-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "interface-9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-c7efbdb0-e5e1-498a-890a-2f670253e25e" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.453s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:09 user nova-compute[82522]: INFO nova.compute.manager [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Rescuing
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquired lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG nova.network.neutron [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-plugged-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] No waiting events found dispatching network-vif-plugged-c7efbdb0-e5e1-498a-890a-2f670253e25e {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:09 user nova-compute[82522]: WARNING nova.compute.manager [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received unexpected event network-vif-plugged-c7efbdb0-e5e1-498a-890a-2f670253e25e for instance with vm_state active and task_state None.
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:09 user nova-compute[82522]: INFO nova.compute.manager [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Unshelving
Apr 17 10:40:09 user nova-compute[82522]: INFO nova.virt.block_device [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Booting with volume 32955c44-ba4e-4422-bebe-32b68bb7b970 at /dev/vda
Apr 17 10:40:09 user nova-compute[82522]: DEBUG os_brick.utils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaf98fd-6332-48a9-84be-fe96e5a3a04a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0115ae-9ab3-4187-9e8d-5981ed5304c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb983e-5824-4c72-8403-e5a104314486]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bda6574-4fcc-4771-925a-5f8b20124871]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:40:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:40:10 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:40:10 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3969f2-2546-4941-acc5-0256b3d0d207]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG os_brick.utils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating existing volume attachment record: 2c52f176-4bd4-4e80-a5fa-358e10dc9225 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG nova.network.neutron [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating instance_info_cache with network_info: [{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Releasing lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:10 user nova-compute[82522]: WARNING nova.compute.manager [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state active and task_state rescuing.
Apr 17 10:40:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:11 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Instance destroyed successfully.
Apr 17 10:40:11 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Attempting a stable device rescue
Apr 17 10:40:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82522) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Instance directory exists: not creating {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 10:40:11 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Creating image(s)
Apr 17 10:40:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "/opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "/opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG nova.objects.instance [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "dc7180832b7bcf2f1502792958782d9adb6df2cc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "dc7180832b7bcf2f1502792958782d9adb6df2cc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc.part --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.images [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] ce3ae2b5-2bb7-4d2a-8b63-e4367e4d36a7 was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc.part /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc.part /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc.converted" returned: 0 in 0.247s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "dc7180832b7bcf2f1502792958782d9adb6df2cc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.418s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "dc7180832b7bcf2f1502792958782d9adb6df2cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "dc7180832b7bcf2f1502792958782d9adb6df2cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc,backing_fmt=raw /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:12 user nova-compute[82522]: WARNING nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state active and task_state rescuing.
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:12 user nova-compute[82522]: WARNING nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state active and task_state rescuing.
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:12 user nova-compute[82522]: WARNING nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state active and task_state rescuing.
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:12 user nova-compute[82522]: WARNING nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state active and task_state rescuing.
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:12 user nova-compute[82522]: WARNING nova.compute.manager [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state active and task_state rescuing.
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc,backing_fmt=raw /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue" returned: 0 in 0.191s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "dc7180832b7bcf2f1502792958782d9adb6df2cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.objects.instance [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'migration_context' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Start _get_guest_xml network_info=[{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "vif_mac": "fa:16:3e:c8:ce:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ce3ae2b5-2bb7-4d2a-8b63-e4367e4d36a7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '7e76d82a-4df0-4510-af8f-d38a5cfc55ea', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkayWePI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab', 'attached_at': '', 'detached_at': '', 'volume_id': '263e05e5-5c44-4a01-bf88-51f9038d2169', 'serial': '263e05e5-5c44-4a01-bf88-51f9038d2169'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.objects.instance [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'resources' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.objects.instance [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'numa_topology' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:12 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:40:12 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:40:12 user nova-compute[82522]: DEBUG nova.objects.instance [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkayWePI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:13 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:13 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:13 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbceb99-99c3-4b92-bfb6-87d793eb31dc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BkayWePI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 17 10:40:13 user nova-compute[82522]: node.name = iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:40:13 user nova-compute[82522]: node.tpgt = -1
Apr 17 10:40:13 user nova-compute[82522]: node.startup = automatic
Apr 17 10:40:13 user nova-compute[82522]: node.leading_login = No
Apr 17 10:40:13 user nova-compute[82522]: iface.iscsi_ifacename = default
Apr 17 10:40:13 user nova-compute[82522]: iface.net_ifacename = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.ipaddress = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.prefix_len = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.hwaddress = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.transport_name = tcp
Apr 17 10:40:13 user nova-compute[82522]: iface.initiatorname = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.state = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.vlan_id = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.vlan_priority = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.vlan_state = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.iface_num = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.mtu = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.port = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.bootproto = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.subnet_mask = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.gateway = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.dhcp_alt_client_id_state = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.dhcp_alt_client_id = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.dhcp_dns = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.dhcp_learn_iqn = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.dhcp_req_vendor_id_state = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.dhcp_vendor_id_state = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.dhcp_vendor_id = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.dhcp_slp_da = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.fragmentation = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.gratuitous_arp = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.incoming_forwarding = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.tos_state = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.tos = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.ttl = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.delayed_ack = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.tcp_nagle = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.tcp_wsf_state = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.tcp_wsf = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.tcp_timer_scale = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.tcp_timestamp = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.redirect = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.def_task_mgmt_timeout = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.header_digest = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.data_digest = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.immediate_data = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.initial_r2t = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.data_seq_inorder = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.data_pdu_inorder = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.erl = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.max_receive_data_len = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.first_burst_len = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.max_outstanding_r2t = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.max_burst_len = 0
Apr 17 10:40:13 user nova-compute[82522]: iface.chap_auth = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.bidi_chap = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.strict_login_compliance = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.discovery_auth = <empty>
Apr 17 10:40:13 user nova-compute[82522]: iface.discovery_logout = <empty>
Apr 17 10:40:13 user nova-compute[82522]: node.discovery_address = <empty>
Apr 17 10:40:13 user nova-compute[82522]: node.discovery_port = 0
Apr 17 10:40:13 user nova-compute[82522]: node.discovery_type = static
Apr 17 10:40:13 user nova-compute[82522]: node.session.initial_cmdsn = 0
Apr 17 10:40:13 user nova-compute[82522]: node.session.initial_login_retry_max = 8
Apr 17 10:40:13 user nova-compute[82522]: node.session.xmit_thread_priority = -20
Apr 17 10:40:13 user nova-compute[82522]: node.session.cmds_max = 128
Apr 17 10:40:13 user nova-compute[82522]: node.session.queue_depth = 32
Apr 17 10:40:13 user nova-compute[82522]: node.session.nr_sessions = 1
Apr 17 10:40:13 user nova-compute[82522]: node.session.auth.authmethod = CHAP
Apr 17 10:40:13 user nova-compute[82522]: node.session.auth.username = BkayWePI
Apr 17 10:40:13 user nova-compute[82522]: node.session.auth.password = ***
Apr 17 10:40:13 user nova-compute[82522]: node.session.auth.username_in = <empty>
Apr 17 10:40:13 user nova-compute[82522]: node.session.auth.password_in = <empty>
Apr 17 10:40:13 user nova-compute[82522]: node.session.auth.chap_algs = MD5
Apr 17 10:40:13 user nova-compute[82522]: node.session.timeo.replacement_timeout = 120
Apr 17 10:40:13 user nova-compute[82522]: node.session.err_timeo.abort_timeout = 15
Apr 17 10:40:13 user nova-compute[82522]: node.session.err_timeo.lu_reset_timeout = 30
Apr 17 10:40:13 user nova-compute[82522]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 17 10:40:13 user nova-compute[82522]: node.session.err_timeo.host_reset_timeout = 60
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.FastAbort = Yes
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.InitialR2T = No
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.ImmediateData = Yes
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.FirstBurstLength = 262144
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.MaxBurstLength = 16776192
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.DefaultTime2Retain = 0
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.DefaultTime2Wait = 2
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.MaxConnections = 1
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 17 10:40:13 user nova-compute[82522]: node.session.iscsi.ERL = 0
Apr 17 10:40:13 user nova-compute[82522]: node.session.scan = manual
Apr 17 10:40:13 user nova-compute[82522]: node.session.reopen_max = 0
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].address = 172.16.0.220
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].port = 3260
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].startup = manual
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].tcp.window_size = 524288
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].tcp.type_of_service = 0
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].timeo.logout_timeout = 15
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].timeo.login_timeout = 15
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].timeo.auth_timeout = 45
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].timeo.noop_out_interval = 5
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].timeo.noop_out_timeout = 5
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].iscsi.HeaderDigest = None
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].iscsi.DataDigest = None
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].iscsi.IFMarker = No
Apr 17 10:40:13 user nova-compute[82522]: node.conn[0].iscsi.OFMarker = No
Apr 17 10:40:13 user nova-compute[82522]: # END RECORD
Apr 17 10:40:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16c6863-a678-4f9a-abc1-02aadcd26179]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee3bb78-2da2-4867-b842-b7b149f13f60]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BkayWePI {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BkayWePI" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c90f8a-aa3e-4f5d-be26-8b649a028a05]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BkayWePI'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8a558a-93ad-4ec5-8318-b605fd8b5b1b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9833cac4-0170-4f93-8e92-8411ddbfaded]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:13 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:13 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:13 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:13 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:13 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:13 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8c831c-fc5d-47df-a393-6f6e32178b10]: (4, ('0 0 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkayWePI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23566396132313836', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566396132313836', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1770450591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1770450591',id=13,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-zpux0ozq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:38:36Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "vif_mac": "fa:16:3e:c8:ce:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "vif_mac": "fa:16:3e:c8:ce:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ce:9e,bridge_name='br-int',has_traffic_filtering=True,id=2acfe658-2dce-4086-b24a-ef0b4c3714f8,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2acfe658-2d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.objects.instance [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:40:13 user nova-compute[82522]:   <uuid>1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab</uuid>
Apr 17 10:40:13 user nova-compute[82522]:   <name>instance-0000000d</name>
Apr 17 10:40:13 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:40:13 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:40:13 user nova-compute[82522]:   <metadata>
Apr 17 10:40:13 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:40:13 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:40:13 user nova-compute[82522]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1770450591</nova:name>
Apr 17 10:40:13 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:40:12</nova:creationTime>
Apr 17 10:40:13 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:40:13 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:40:13 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:40:13 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:40:13 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:40:13 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:40:13 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:40:13 user nova-compute[82522]:       <nova:owner>
Apr 17 10:40:13 user nova-compute[82522]:         <nova:user uuid="d8cb73d24d324903a625e4782270120e">tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member</nova:user>
Apr 17 10:40:13 user nova-compute[82522]:         <nova:project uuid="faab4afa0ddf45578232627c2fac2ff8">tempest-ServerBootFromVolumeStableRescueTest-933538997</nova:project>
Apr 17 10:40:13 user nova-compute[82522]:       </nova:owner>
Apr 17 10:40:13 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:40:13 user nova-compute[82522]:       <nova:ports>
Apr 17 10:40:13 user nova-compute[82522]:         <nova:port uuid="2acfe658-2dce-4086-b24a-ef0b4c3714f8">
Apr 17 10:40:13 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 10:40:13 user nova-compute[82522]:         </nova:port>
Apr 17 10:40:13 user nova-compute[82522]:       </nova:ports>
Apr 17 10:40:13 user nova-compute[82522]:     </nova:instance>
Apr 17 10:40:13 user nova-compute[82522]:   </metadata>
Apr 17 10:40:13 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:40:13 user nova-compute[82522]:     <system>
Apr 17 10:40:13 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:40:13 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:40:13 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:40:13 user nova-compute[82522]:       <entry name="serial">1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab</entry>
Apr 17 10:40:13 user nova-compute[82522]:       <entry name="uuid">1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab</entry>
Apr 17 10:40:13 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:40:13 user nova-compute[82522]:     </system>
Apr 17 10:40:13 user nova-compute[82522]:   </sysinfo>
Apr 17 10:40:13 user nova-compute[82522]:   <os>
Apr 17 10:40:13 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:40:13 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:40:13 user nova-compute[82522]:   </os>
Apr 17 10:40:13 user nova-compute[82522]:   <features>
Apr 17 10:40:13 user nova-compute[82522]:     <acpi/>
Apr 17 10:40:13 user nova-compute[82522]:     <apic/>
Apr 17 10:40:13 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:40:13 user nova-compute[82522]:   </features>
Apr 17 10:40:13 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:40:13 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:40:13 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:40:13 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:40:13 user nova-compute[82522]:   </clock>
Apr 17 10:40:13 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:40:13 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:40:13 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:40:13 user nova-compute[82522]:   </cpu>
Apr 17 10:40:13 user nova-compute[82522]:   <devices>
Apr 17 10:40:13 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:40:13 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:13 user nova-compute[82522]:       <source dev="/dev/sdb"/>
Apr 17 10:40:13 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:40:13 user nova-compute[82522]:       <serial>263e05e5-5c44-4a01-bf88-51f9038d2169</serial>
Apr 17 10:40:13 user nova-compute[82522]:     </disk>
Apr 17 10:40:13 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:40:13 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:40:13 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue"/>
Apr 17 10:40:13 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:40:13 user nova-compute[82522]:       <boot order="1"/>
Apr 17 10:40:13 user nova-compute[82522]:     </disk>
Apr 17 10:40:13 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:40:13 user nova-compute[82522]:       <mac address="fa:16:3e:c8:ce:9e"/>
Apr 17 10:40:13 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:40:13 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:40:13 user nova-compute[82522]:       <target dev="tap2acfe658-2d"/>
Apr 17 10:40:13 user nova-compute[82522]:     </interface>
Apr 17 10:40:13 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:40:13 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/console.log" append="off"/>
Apr 17 10:40:13 user nova-compute[82522]:     </serial>
Apr 17 10:40:13 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:40:13 user nova-compute[82522]:     <video>
Apr 17 10:40:13 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:40:13 user nova-compute[82522]:     </video>
Apr 17 10:40:13 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:40:13 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:40:13 user nova-compute[82522]:     </rng>
Apr 17 10:40:13 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:40:13 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:40:13 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:40:13 user nova-compute[82522]:     </memballoon>
Apr 17 10:40:13 user nova-compute[82522]:   </devices>
Apr 17 10:40:13 user nova-compute[82522]: </domain>
Apr 17 10:40:13 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:40:13 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Instance destroyed successfully.
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:40:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No VIF found with MAC fa:16:3e:c8:ce:9e, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:14 user nova-compute[82522]: WARNING nova.compute.manager [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state active and task_state rescuing.
Apr 17 10:40:15 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728016.7048118, 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:40:16 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] VM Resumed (Lifecycle Event)
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:40:16 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728016.706405, 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:40:16 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] VM Started (Lifecycle Event)
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.compute.manager [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:16 user nova-compute[82522]: DEBUG nova.compute.manager [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:16 user nova-compute[82522]: WARNING nova.compute.manager [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state rescued and task_state None.
Apr 17 10:40:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 10:40:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updating instance_info_cache with network_info: [{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:18 user nova-compute[82522]: INFO nova.compute.manager [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Detaching volume 1e959d4f-1d94-402d-84d5-323e6a987d67
Apr 17 10:40:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lazy-loading 'pci_requests' on Instance uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lazy-loading 'numa_topology' on Instance uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:40:18 user nova-compute[82522]: INFO nova.compute.claims [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Claim successful on node user
Apr 17 10:40:18 user nova-compute[82522]: INFO nova.virt.block_device [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Attempting to driver detach volume 1e959d4f-1d94-402d-84d5-323e6a987d67 from mountpoint /dev/vdc
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Attempting to detach device vdc from instance c4315753-415c-45cd-b06f-da1e3ccc6e4d from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:40:18 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:18 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:40:18 user nova-compute[82522]:   <target dev="vdc" bus="virtio"/>
Apr 17 10:40:18 user nova-compute[82522]:   <serial>1e959d4f-1d94-402d-84d5-323e6a987d67</serial>
Apr 17 10:40:18 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 10:40:18 user nova-compute[82522]: </disk>
Apr 17 10:40:18 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully detached device vdc from instance c4315753-415c-45cd-b06f-da1e3ccc6e4d from the persistent domain config.
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c4315753-415c-45cd-b06f-da1e3ccc6e4d from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:40:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:40:18 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:18 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:40:18 user nova-compute[82522]:   <target dev="vdc" bus="virtio"/>
Apr 17 10:40:18 user nova-compute[82522]:   <serial>1e959d4f-1d94-402d-84d5-323e6a987d67</serial>
Apr 17 10:40:18 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 10:40:18 user nova-compute[82522]: </disk>
Apr 17 10:40:18 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:19 user nova-compute[82522]: INFO nova.network.neutron [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728019.4570327, c4315753-415c-45cd-b06f-da1e3ccc6e4d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:40:19 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully detached device vdc from instance c4315753-415c-45cd-b06f-da1e3ccc6e4d from the live domain config.
Apr 17 10:40:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUvdFypT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:19 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d7a0d8-54fd-4c2f-9881-49ced1f066eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:40:19 user nova-compute[82522]: No targets found.
Apr 17 10:40:19 user nova-compute[82522]: iSNS:
Apr 17 10:40:19 user nova-compute[82522]: No targets found.
Apr 17 10:40:19 user nova-compute[82522]: STATIC:
Apr 17 10:40:19 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:40:19 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:19 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:19 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:40:19 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:19 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:19 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67
Apr 17 10:40:19 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:19 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:19 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:40:19 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:19 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:19 user nova-compute[82522]: FIRMWARE:
Apr 17 10:40:19 user nova-compute[82522]: No targets found.
Apr 17 10:40:19 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:40:19 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:40:19 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e05ab9d-2c36-429f-9589-ef22b543f840]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d306f53-11f1-4376-90d5-ededc9003cbb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:19 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:19 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:19 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:19 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:19 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:19 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:19 user nova-compute[82522]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 (non-flash)
Apr 17 10:40:19 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7cdaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67'): ({'sde'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Removing single pathed devices sde {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a977ae5f-a90e-4c89-9ab7-24632987962a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8220a26-8d07-4709-a317-a8abb4bbe563]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flushing IO for device /dev/sde {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[197eb951-1835-4c07-a583-4e428a40aafb]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c14c4c-8cf2-49d7-b809-5821508f7046]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eee59bc-b4aa-44e5-9f9f-e19983e8d4df]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0e24d4-f328-4ac4-b66e-d98b0854e41a]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67, portal: 172.16.0.220,3260]
Apr 17 10:40:19 user nova-compute[82522]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67, portal: 172.16.0.220,3260] successful.
Apr 17 10:40:19 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959d4f-1d94-402d-84d5-323e6a987d67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cf363c-feb1-4c9b-86db-343b7692c068]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] <== disconnect_volume: return (373ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquired lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing instance network info cache due to event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] Acquiring lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Releasing lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:40:20 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Creating image(s)
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Ensure instance console log exists: /opt/stack/data/nova/instances/b0c707ac-b08f-4f18-8262-e1b79d7e17e1/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Start _get_guest_xml network_info=[{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '2c52f176-4bd4-4e80-a5fa-358e10dc9225', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amnpFeIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0c707ac-b08f-4f18-8262-e1b79d7e17e1', 'attached_at': '', 'detached_at': '', 'volume_id': '32955c44-ba4e-4422-bebe-32b68bb7b970', 'serial': '32955c44-ba4e-4422-bebe-32b68bb7b970'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] Acquired lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.network.neutron [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:40:20 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:40:20 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amnpFeIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:20 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:20 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:20 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e4fe24-c6a5-40a5-b211-b77b0991f621]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:40:20 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ae85b9-b141-47ae-8c5a-2bd3abc0d0ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970] added
Apr 17 10:40:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dc29e1-bde1-4176-bbeb-a57393af37bb]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fde48a1-4c94-4ad7-be00-e7f8080b8252]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amnpFeIh {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amnpFeIh" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d6812b-e567-40ed-8acd-a21410e2d926]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'amnpFeIh'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0307b53a-0c94-408a-bce2-b03866a82280]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eb0b86-6ac0-47a2-8133-45c90b423e1a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e42943-abbe-4da6-bfc7-e27ba71f6528]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260]
Apr 17 10:40:20 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260] successful.
Apr 17 10:40:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8475fa39-e2c5-4e69-bfaa-563b52d984ac]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG nova.objects.instance [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'flavor' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eb01c9-e959-4c12-81c9-df72b5e4f259]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:20 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0feaad8-7038-49fb-8328-2aa54b87e9c3]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amnpFeIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:40:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.161s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:21 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:21 user nova-compute[82522]: DEBUG nova.network.neutron [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updated VIF entry in instance network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:40:21 user nova-compute[82522]: DEBUG nova.network.neutron [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] Releasing lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:40:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23531646630656239', 'path': '/dev/sde'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531646630656239', 'path': '/dev/sde'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-906009009',display_name='tempest-TestShelveInstance-server-906009009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-906009009',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-993329906',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5a793afb3e7045898c59a77975079d72',ramdisk_id='',reservation_id='r-g168xrnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2028370832',owner_user_name='tempest-TestShelveInstance-2028370832-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:40:10Z,user_data=None,user_id='b43c0aee7b05459d898e0dc2654262fa',uuid=b0c707ac-b08f-4f18-8262-e1b79d7e17e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converting VIF {"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lazy-loading 'pci_devices' on Instance uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:40:22 user nova-compute[82522]:   <uuid>b0c707ac-b08f-4f18-8262-e1b79d7e17e1</uuid>
Apr 17 10:40:22 user nova-compute[82522]:   <name>instance-0000000b</name>
Apr 17 10:40:22 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:40:22 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:40:22 user nova-compute[82522]:   <metadata>
Apr 17 10:40:22 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:40:22 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:40:22 user nova-compute[82522]:       <nova:name>tempest-TestShelveInstance-server-906009009</nova:name>
Apr 17 10:40:22 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:40:20</nova:creationTime>
Apr 17 10:40:22 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:40:22 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:40:22 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:40:22 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:40:22 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:40:22 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:40:22 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:40:22 user nova-compute[82522]:       <nova:owner>
Apr 17 10:40:22 user nova-compute[82522]:         <nova:user uuid="b43c0aee7b05459d898e0dc2654262fa">tempest-TestShelveInstance-2028370832-project-member</nova:user>
Apr 17 10:40:22 user nova-compute[82522]:         <nova:project uuid="5a793afb3e7045898c59a77975079d72">tempest-TestShelveInstance-2028370832</nova:project>
Apr 17 10:40:22 user nova-compute[82522]:       </nova:owner>
Apr 17 10:40:22 user nova-compute[82522]:       <nova:ports>
Apr 17 10:40:22 user nova-compute[82522]:         <nova:port uuid="90c85bb7-50e1-4c86-9c1f-e27f14fb50d3">
Apr 17 10:40:22 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 10:40:22 user nova-compute[82522]:         </nova:port>
Apr 17 10:40:22 user nova-compute[82522]:       </nova:ports>
Apr 17 10:40:22 user nova-compute[82522]:     </nova:instance>
Apr 17 10:40:22 user nova-compute[82522]:   </metadata>
Apr 17 10:40:22 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:40:22 user nova-compute[82522]:     <system>
Apr 17 10:40:22 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:40:22 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:40:22 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:40:22 user nova-compute[82522]:       <entry name="serial">b0c707ac-b08f-4f18-8262-e1b79d7e17e1</entry>
Apr 17 10:40:22 user nova-compute[82522]:       <entry name="uuid">b0c707ac-b08f-4f18-8262-e1b79d7e17e1</entry>
Apr 17 10:40:22 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:40:22 user nova-compute[82522]:     </system>
Apr 17 10:40:22 user nova-compute[82522]:   </sysinfo>
Apr 17 10:40:22 user nova-compute[82522]:   <os>
Apr 17 10:40:22 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:40:22 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:40:22 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:40:22 user nova-compute[82522]:   </os>
Apr 17 10:40:22 user nova-compute[82522]:   <features>
Apr 17 10:40:22 user nova-compute[82522]:     <acpi/>
Apr 17 10:40:22 user nova-compute[82522]:     <apic/>
Apr 17 10:40:22 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:40:22 user nova-compute[82522]:   </features>
Apr 17 10:40:22 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:40:22 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:40:22 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:40:22 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:40:22 user nova-compute[82522]:   </clock>
Apr 17 10:40:22 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:40:22 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:40:22 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:40:22 user nova-compute[82522]:   </cpu>
Apr 17 10:40:22 user nova-compute[82522]:   <devices>
Apr 17 10:40:22 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:40:22 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:22 user nova-compute[82522]:       <source dev="/dev/sde"/>
Apr 17 10:40:22 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:40:22 user nova-compute[82522]:       <serial>32955c44-ba4e-4422-bebe-32b68bb7b970</serial>
Apr 17 10:40:22 user nova-compute[82522]:     </disk>
Apr 17 10:40:22 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:40:22 user nova-compute[82522]:       <mac address="fa:16:3e:c4:70:05"/>
Apr 17 10:40:22 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:40:22 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:40:22 user nova-compute[82522]:       <target dev="tap90c85bb7-50"/>
Apr 17 10:40:22 user nova-compute[82522]:     </interface>
Apr 17 10:40:22 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:40:22 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/b0c707ac-b08f-4f18-8262-e1b79d7e17e1/console.log" append="off"/>
Apr 17 10:40:22 user nova-compute[82522]:     </serial>
Apr 17 10:40:22 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:40:22 user nova-compute[82522]:     <video>
Apr 17 10:40:22 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:40:22 user nova-compute[82522]:     </video>
Apr 17 10:40:22 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:40:22 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:40:22 user nova-compute[82522]:     </rng>
Apr 17 10:40:22 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:40:22 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:40:22 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:40:22 user nova-compute[82522]:     </memballoon>
Apr 17 10:40:22 user nova-compute[82522]:   </devices>
Apr 17 10:40:22 user nova-compute[82522]: </domain>
Apr 17 10:40:22 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-906009009',display_name='tempest-TestShelveInstance-server-906009009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-906009009',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-993329906',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5a793afb3e7045898c59a77975079d72',ramdisk_id='',reservation_id='r-g168xrnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2028370832',owner_user_name='tempest-TestShelveInstance-2028370832-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:40:10Z,user_data=None,user_id='b43c0aee7b05459d898e0dc2654262fa',uuid=b0c707ac-b08f-4f18-8262-e1b79d7e17e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converting VIF {"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG os_vif [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90c85bb7-50, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90c85bb7-50, col_values=(('external_ids', {'iface-id': '90c85bb7-50e1-4c86-9c1f-e27f14fb50d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:70:05', 'vm-uuid': 'b0c707ac-b08f-4f18-8262-e1b79d7e17e1'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:22 user nova-compute[82522]: INFO os_vif [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50')
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] No VIF found with MAC fa:16:3e:c4:70:05, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received event network-changed-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Refreshing instance network info cache due to event network-changed-e66863ce-1b10-4701-9a7c-3940117a0237. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] Acquiring lock "refresh_cache-89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] Acquired lock "refresh_cache-89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:40:22 user nova-compute[82522]: DEBUG nova.network.neutron [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Refreshing network info cache for port e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:23 user nova-compute[82522]: INFO nova.compute.manager [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Detaching volume 77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:40:23 user nova-compute[82522]: INFO nova.virt.block_device [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Attempting to driver detach volume 77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 from mountpoint /dev/vdb
Apr 17 10:40:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Attempting to detach device vdb from instance 59fd26de-d46e-4f41-91f6-090005a07d99 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:40:23 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:23 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:40:23 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:40:23 user nova-compute[82522]:   <serial>77166f39-c9b1-499f-9ed8-1fdd6a0d81a1</serial>
Apr 17 10:40:23 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 10:40:23 user nova-compute[82522]: </disk>
Apr 17 10:40:23 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:23 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully detached device vdb from instance 59fd26de-d46e-4f41-91f6-090005a07d99 from the persistent domain config.
Apr 17 10:40:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59fd26de-d46e-4f41-91f6-090005a07d99 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:40:23 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:23 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:40:23 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:40:23 user nova-compute[82522]:   <serial>77166f39-c9b1-499f-9ed8-1fdd6a0d81a1</serial>
Apr 17 10:40:23 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 10:40:23 user nova-compute[82522]: </disk>
Apr 17 10:40:23 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG nova.network.neutron [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Updated VIF entry in instance network info cache for port e66863ce-1b10-4701-9a7c-3940117a0237. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG nova.network.neutron [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Updating instance_info_cache with network_info: [{"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] Releasing lock "refresh_cache-89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:40:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728024.0725143, 59fd26de-d46e-4f41-91f6-090005a07d99 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:40:24 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully detached device vdb from instance 59fd26de-d46e-4f41-91f6-090005a07d99 from the live domain config.
Apr 17 10:40:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXJauTtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:24 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf2ace-d5f3-49f5-b586-bfaae0a638e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:40:24 user nova-compute[82522]: No targets found.
Apr 17 10:40:24 user nova-compute[82522]: iSNS:
Apr 17 10:40:24 user nova-compute[82522]: No targets found.
Apr 17 10:40:24 user nova-compute[82522]: STATIC:
Apr 17 10:40:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:40:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:40:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:40:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1
Apr 17 10:40:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:24 user nova-compute[82522]: FIRMWARE:
Apr 17 10:40:24 user nova-compute[82522]: No targets found.
Apr 17 10:40:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:40:24 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:40:24 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a24cb6-b0a2-4cbf-a9d7-4811ddc86d99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb417e30-f5d6-4a92-8a73-af0c1d984872]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:24 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:24 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:24 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:24 user nova-compute[82522]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 (non-flash)
Apr 17 10:40:24 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:24 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2a470bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1'): ({'sdc'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Removing single pathed devices sdc {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca7bddf-72c5-4829-a639-0f35e152bd4c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd98e339-52f2-4034-aeb7-cf8c13196348]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flushing IO for device /dev/sdc {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab844fc6-bba7-494f-8c43-ec1687a4e0aa]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[843e20bf-01b2-49e1-93d7-16b9270ad151]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed25ac7-4ea0-4e60-83fc-34b1cf20d3b7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b57d34b-0361-427c-a182-c30de9cb3a69]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260]
Apr 17 10:40:24 user nova-compute[82522]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1, portal: 172.16.0.220,3260] successful.
Apr 17 10:40:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58c6c6d-c0de-4a76-ba04-cc25c999975e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== disconnect_volume: return (340ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] No waiting events found dispatching network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:25 user nova-compute[82522]: WARNING nova.compute.manager [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received unexpected event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 17 10:40:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] No waiting events found dispatching network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:25 user nova-compute[82522]: WARNING nova.compute.manager [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received unexpected event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.273s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728026.071651, b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:40:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] VM Resumed (Lifecycle Event)
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:40:26 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Instance spawned successfully.
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:40:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728026.092403, b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:40:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] VM Started (Lifecycle Event)
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.485s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82522) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.objects.instance [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG nova.objects.instance [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'flavor' on Instance uuid 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:27 user nova-compute[82522]: INFO nova.compute.manager [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Attaching volume d55ca633-67ce-4587-8e19-e82124e3702d to /dev/vdb
Apr 17 10:40:27 user nova-compute[82522]: DEBUG nova.compute.manager [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-unplugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG nova.compute.manager [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-unplugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:27 user nova-compute[82522]: WARNING nova.compute.manager [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-unplugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state active and task_state powering-off.
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG os_brick.utils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ac1ce-dc21-47d7-be30-de3337a9907d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efa4d2f-8173-4b2a-b104-9cfb6ed1d155]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[46027fb5-6cc5-47f0-abd6-31b01fca8540]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d702c897-2459-4a67-af3a-c6079efaa9fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:40:27 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e272884-3aa0-419c-bc20-6e08bc8583f4]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG os_brick.utils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Updating existing volume attachment record: 03857cb0-49c7-4dc4-adf9-6c1ae360bff0 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:40:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance destroyed successfully.
Apr 17 10:40:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.910s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:28 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:40:28 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=7700MB free_disk=26.425827026367188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 59fd26de-d46e-4f41-91f6-090005a07d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 7792cf72-dc73-4201-9501-4515ce860735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:28 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:29 user nova-compute[82522]: WARNING nova.compute.manager [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state stopped and task_state None.
Apr 17 10:40:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyWxbNwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:32 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:32 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:32 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0272a42-97b1-48c7-9d42-38a0c87c030f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:40:32 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab748726-d257-44e8-b86a-aec12fa68067]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d] added
Apr 17 10:40:32 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af10b7-abf9-4775-84cb-0417e7b32de0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9834b7-db52-4c44-931c-d66c737cfc2f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyWxbNwk {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyWxbNwk" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed230048-893c-434b-9f5c-c46fdc707510]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HyWxbNwk'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6130940e-f80d-44d0-b8c5-814dced31b08]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b31a59-3d08-40d3-9e19-75fad19bc906]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d86862-c224-4ca9-b63e-72488710a09a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d, portal: 172.16.0.220,3260]
Apr 17 10:40:32 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d, portal: 172.16.0.220,3260] successful.
Apr 17 10:40:32 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d890a37-583d-4983-9942-90c5114bf15a]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9376be24-b767-4d0b-945d-e64f81766a79]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d (non-flash)
Apr 17 10:40:32 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:32 user nova-compute[82522]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d (non-flash)
Apr 17 10:40:32 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7990bf15-a5d2-4133-9944-ee2aebb44505]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:32 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:40:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:40:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyWxbNwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:40:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23337393233663830', 'path': '/dev/sdc'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337393233663830', 'path': '/dev/sdc'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:40:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'flavor' on Instance uuid 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:40:33 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:33 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:40:33 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:40:33 user nova-compute[82522]:   <serial>d55ca633-67ce-4587-8e19-e82124e3702d</serial>
Apr 17 10:40:33 user nova-compute[82522]: </disk>
Apr 17 10:40:33 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:40:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:40:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:40:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] No VIF found with MAC fa:16:3e:ba:1a:44, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:40:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.308s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:35 user nova-compute[82522]: INFO nova.compute.manager [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Detaching volume d55ca633-67ce-4587-8e19-e82124e3702d
Apr 17 10:40:35 user nova-compute[82522]: INFO nova.virt.block_device [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Attempting to driver detach volume d55ca633-67ce-4587-8e19-e82124e3702d from mountpoint /dev/vdb
Apr 17 10:40:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Attempting to detach device vdb from instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:40:35 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:35 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:40:35 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:40:35 user nova-compute[82522]:   <serial>d55ca633-67ce-4587-8e19-e82124e3702d</serial>
Apr 17 10:40:35 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:40:35 user nova-compute[82522]: </disk>
Apr 17 10:40:35 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Successfully detached device vdb from instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf from the persistent domain config.
Apr 17 10:40:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:40:35 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:35 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:40:35 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:40:35 user nova-compute[82522]:   <serial>d55ca633-67ce-4587-8e19-e82124e3702d</serial>
Apr 17 10:40:35 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:40:35 user nova-compute[82522]: </disk>
Apr 17 10:40:35 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728035.8137834, 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:40:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Successfully detached device vdb from instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf from the live domain config.
Apr 17 10:40:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyWxbNwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:35 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[602fb50f-e538-4fc3-b53a-544eaa114f22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:40:35 user nova-compute[82522]: No targets found.
Apr 17 10:40:35 user nova-compute[82522]: iSNS:
Apr 17 10:40:35 user nova-compute[82522]: No targets found.
Apr 17 10:40:35 user nova-compute[82522]: STATIC:
Apr 17 10:40:35 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d
Apr 17 10:40:35 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:35 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:35 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:40:35 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:35 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:35 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:40:35 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:35 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:35 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:40:35 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:40:35 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:40:35 user nova-compute[82522]: FIRMWARE:
Apr 17 10:40:35 user nova-compute[82522]: No targets found.
Apr 17 10:40:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:40:35 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:40:35 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:35 user nova-compute[82522]: INFO nova.compute.manager [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Unrescuing
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquired lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5034af-e0db-40f7-8d6e-d2ab9e747565]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[298d0853-3825-475a-8890-c9515640ae9e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:35 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:35 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:35 user nova-compute[82522]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d (non-flash)
Apr 17 10:40:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:35 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:35 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:35 user nova-compute[82522]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d (non-flash)
Apr 17 10:40:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2844af370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d'): ({'sdc'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Removing single pathed devices sdc {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fac21a-78fc-469b-9b1f-29af9322d2d5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2376ba-2fbb-4839-ba11-f9b631adbc81]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Flushing IO for device /dev/sdc {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafd4d84-fb2c-4ce6-b179-ead96aaf31cf]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:40:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fcc71d-80a6-4ef5-8d4a-534066690f14]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e572d676-9a41-46c8-881a-d7ae3a7abe83]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdfa07c-548d-4f8a-aa29-09b2b725511e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d, portal: 172.16.0.220,3260]
Apr 17 10:40:36 user nova-compute[82522]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d, portal: 172.16.0.220,3260] successful.
Apr 17 10:40:36 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55ca633-67ce-4587-8e19-e82124e3702d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a9b0e-5154-42ac-8080-0826b5d477ba]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] <== disconnect_volume: return (312ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Releasing lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG nova.objects.instance [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'flavor' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:36 user nova-compute[82522]: WARNING nova.compute.manager [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:40:36 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'flavor' on Instance uuid 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.734s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-changed-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Refreshing instance network info cache due to event network-changed-f839dea5-4294-4842-bfa2-262351dabfb9. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] Acquiring lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] Acquired lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Refreshing network info cache for port f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:37 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Instance destroyed successfully.
Apr 17 10:40:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG nova.network.neutron [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updated VIF entry in instance network info cache for port f839dea5-4294-4842-bfa2-262351dabfb9. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG nova.network.neutron [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] Releasing lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:39 user nova-compute[82522]: WARNING nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:39 user nova-compute[82522]: WARNING nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:39 user nova-compute[82522]: WARNING nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:39 user nova-compute[82522]: WARNING nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:39 user nova-compute[82522]: WARNING nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:39 user nova-compute[82522]: WARNING nova.compute.manager [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-changed-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Refreshing instance network info cache due to event network-changed-f839dea5-4294-4842-bfa2-262351dabfb9. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] Acquiring lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] Acquired lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Refreshing network info cache for port f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updated VIF entry in instance network info cache for port f839dea5-4294-4842-bfa2-262351dabfb9. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:40:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] Releasing lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728041.0136771, e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:40:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] VM Resumed (Lifecycle Event)
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:40:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728041.0154886, e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:40:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] VM Started (Lifecycle Event)
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:41 user nova-compute[82522]: WARNING nova.compute.manager [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state active and task_state None.
Apr 17 10:40:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:42 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728027.533161, 59fd26de-d46e-4f41-91f6-090005a07d99 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:40:42 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] VM Stopped (Lifecycle Event)
Apr 17 10:40:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-0083a9fb-f20f-4bca-98cf-4d4f4c374613 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:40:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-0083a9fb-f20f-4bca-98cf-4d4f4c374613 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:40:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:53 user nova-compute[82522]: INFO nova.compute.manager [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attaching volume 6b225ba1-7dd8-420b-8e44-cae7e5b7a53b to /dev/vdb
Apr 17 10:40:53 user nova-compute[82522]: DEBUG os_brick.utils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b2fcc9-6ca8-4d86-b384-c726103d0b2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[878f44d2-9721-4b2f-8deb-c953145289c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[734af7c2-c448-4ec1-91e2-d5bc40dd868f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eac310-8220-40f0-ac1b-5333d6731537]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:40:53 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:40:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3ebdf6-0b2b-4c35-8ed2-a1b232925b53]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG os_brick.utils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating existing volume attachment record: ca73622f-6794-4fe9-a689-718e710db8c2 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:40:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:40:57 user nova-compute[82522]: INFO nova.compute.claims [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Claim successful on node user
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.network.neutron [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:40:57 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.policy [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:40:57 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Creating image(s)
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "/opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "/opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:57 user nova-compute[82522]: INFO nova.compute.manager [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Terminating instance
Apr 17 10:40:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.204s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk 1073741824" returned: 0 in 0.054s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-unplugged-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] No waiting events found dispatching network-vif-unplugged-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-unplugged-3106e21d-664e-4c17-85be-f0a654c4eabc for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMUwxcJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:40:58 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:58 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:40:58 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e838ccb8-e6ae-4ac8-a64b-ed1b0087e567]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:40:58 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[948b90bb-4506-42c6-a814-838a4c18a08b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b] added
Apr 17 10:40:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78d9ef0-a171-4500-ae2b-49b2a9a3e92e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[db77dcf9-28c0-4f01-9162-5ea9c5661bf1]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMUwxcJv {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Cannot resize image /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.objects.instance [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lazy-loading 'migration_context' on Instance uuid b0a9753b-207e-4c23-9fea-f7dc89a5edf7 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMUwxcJv" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[460dbc0e-158e-4cfc-a16d-e69084ea5805]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMUwxcJv'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[49349816-c25b-42d3-9716-06c86f7c0850]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.network.neutron [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Successfully created port: 6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee72a3e2-cd65-4626-9f58-b8ac53f4f345]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Ensure instance console log exists: /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0784d2fe-53d1-4a43-85a0-17c03b12ee6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b, portal: 172.16.0.220,3260]
Apr 17 10:40:58 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b, portal: 172.16.0.220,3260] successful.
Apr 17 10:40:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Instance destroyed successfully.
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'resources' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1261b2-0ce9-48ac-96d6-a485d0263a20]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T10:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1840654553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1840654553',id=12,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA==',key_name='tempest-keypair-1227280417',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='507228fb562e461e91a628829ce32d80',ramdisk_id='',reservation_id='r-fakqiiql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1382963185',owner_user_name='tempest-TaggedAttachmentsTest-1382963185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab512fbd85694415a5f7af8b689814d4',uuid=9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converting VIF {"id": "3106e21d-664e-4c17-85be-f0a654c4eabc", "address": "fa:16:3e:b0:13:f7", "network": {"id": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1712384109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "507228fb562e461e91a628829ce32d80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3106e21d-66", "ovs_interfaceid": "3106e21d-664e-4c17-85be-f0a654c4eabc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:13:f7,bridge_name='br-int',has_traffic_filtering=True,id=3106e21d-664e-4c17-85be-f0a654c4eabc,network=Network(a4860ea0-3765-4c0e-a5dd-6f9f5268734a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3106e21d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_vif [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:13:f7,bridge_name='br-int',has_traffic_filtering=True,id=3106e21d-664e-4c17-85be-f0a654c4eabc,network=Network(a4860ea0-3765-4c0e-a5dd-6f9f5268734a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3106e21d-66') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3106e21d-66, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a89c4dd-9e17-485f-98d0-836d98167bcb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b (non-flash)
Apr 17 10:40:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:40:58 user nova-compute[82522]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b (non-flash)
Apr 17 10:40:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:40:58 user nova-compute[82522]: INFO os_vif [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:13:f7,bridge_name='br-int',has_traffic_filtering=True,id=3106e21d-664e-4c17-85be-f0a654c4eabc,network=Network(a4860ea0-3765-4c0e-a5dd-6f9f5268734a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3106e21d-66')
Apr 17 10:40:58 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Deleting instance files /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597_del
Apr 17 10:40:58 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Deletion of /opt/stack/data/nova/instances/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597_del complete
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8034ea3b-7912-4d9c-804e-26f22c961bc0]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMUwxcJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:40:58 user nova-compute[82522]: INFO nova.compute.manager [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 17 10:40:58 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:40:58 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:40:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.482s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:40:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26661346338326237', 'path': '/dev/sdc'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:40:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661346338326237', 'path': '/dev/sdc'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:40:59 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:40:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:40:59 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:40:59 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:40:59 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:40:59 user nova-compute[82522]:   <serial>6b225ba1-7dd8-420b-8e44-cae7e5b7a53b</serial>
Apr 17 10:40:59 user nova-compute[82522]: </disk>
Apr 17 10:40:59 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] No VIF found with MAC fa:16:3e:f8:08:93, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-plugged-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] Acquiring lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] No waiting events found dispatching network-vif-plugged-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:41:00 user nova-compute[82522]: WARNING nova.compute.manager [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received unexpected event network-vif-plugged-3106e21d-664e-4c17-85be-f0a654c4eabc for instance with vm_state active and task_state deleting.
Apr 17 10:41:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.980s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.network.neutron [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Successfully updated port: 6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "refresh_cache-b0a9753b-207e-4c23-9fea-f7dc89a5edf7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquired lock "refresh_cache-b0a9753b-207e-4c23-9fea-f7dc89a5edf7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.network.neutron [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received event network-changed-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Refreshing instance network info cache due to event network-changed-6fac7ecb-de62-4a89-b509-210fa4bedd43. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] Acquiring lock "refresh_cache-b0a9753b-207e-4c23-9fea-f7dc89a5edf7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.network.neutron [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:41:00 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Took 1.86 seconds to deallocate network for instance.
Apr 17 10:41:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.network.neutron [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Updating instance_info_cache with network_info: [{"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Releasing lock "refresh_cache-b0a9753b-207e-4c23-9fea-f7dc89a5edf7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Instance network_info: |[{"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] Acquired lock "refresh_cache-b0a9753b-207e-4c23-9fea-f7dc89a5edf7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.network.neutron [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Refreshing network info cache for port 6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Start _get_guest_xml network_info=[{"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:41:01 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:41:01 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-452716688',display_name='tempest-ServersNegativeTestJSON-server-452716688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-452716688',id=16,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b831c3b6c244dda1821583a6b8cd08',ramdisk_id='',reservation_id='r-00pg4w34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-812869679',owner_user_name='tempest-ServersNegativeTestJSON-812869679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:40:58Z,user_data=None,user_id='1e61a5e172c34636b183ef9c84b714d8',uuid=b0a9753b-207e-4c23-9fea-f7dc89a5edf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converting VIF {"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:83:0d,bridge_name='br-int',has_traffic_filtering=True,id=6fac7ecb-de62-4a89-b509-210fa4bedd43,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fac7ecb-de') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.objects.instance [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lazy-loading 'pci_devices' on Instance uuid b0a9753b-207e-4c23-9fea-f7dc89a5edf7 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:41:01 user nova-compute[82522]:   <uuid>b0a9753b-207e-4c23-9fea-f7dc89a5edf7</uuid>
Apr 17 10:41:01 user nova-compute[82522]:   <name>instance-00000010</name>
Apr 17 10:41:01 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:41:01 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:41:01 user nova-compute[82522]:   <metadata>
Apr 17 10:41:01 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:41:01 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:41:01 user nova-compute[82522]:       <nova:name>tempest-ServersNegativeTestJSON-server-452716688</nova:name>
Apr 17 10:41:01 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:41:01</nova:creationTime>
Apr 17 10:41:01 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:41:01 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:41:01 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:41:01 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:41:01 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:41:01 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:41:01 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:41:01 user nova-compute[82522]:       <nova:owner>
Apr 17 10:41:01 user nova-compute[82522]:         <nova:user uuid="1e61a5e172c34636b183ef9c84b714d8">tempest-ServersNegativeTestJSON-812869679-project-member</nova:user>
Apr 17 10:41:01 user nova-compute[82522]:         <nova:project uuid="a8b831c3b6c244dda1821583a6b8cd08">tempest-ServersNegativeTestJSON-812869679</nova:project>
Apr 17 10:41:01 user nova-compute[82522]:       </nova:owner>
Apr 17 10:41:01 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:41:01 user nova-compute[82522]:       <nova:ports>
Apr 17 10:41:01 user nova-compute[82522]:         <nova:port uuid="6fac7ecb-de62-4a89-b509-210fa4bedd43">
Apr 17 10:41:01 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 17 10:41:01 user nova-compute[82522]:         </nova:port>
Apr 17 10:41:01 user nova-compute[82522]:       </nova:ports>
Apr 17 10:41:01 user nova-compute[82522]:     </nova:instance>
Apr 17 10:41:01 user nova-compute[82522]:   </metadata>
Apr 17 10:41:01 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:41:01 user nova-compute[82522]:     <system>
Apr 17 10:41:01 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:41:01 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:41:01 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:41:01 user nova-compute[82522]:       <entry name="serial">b0a9753b-207e-4c23-9fea-f7dc89a5edf7</entry>
Apr 17 10:41:01 user nova-compute[82522]:       <entry name="uuid">b0a9753b-207e-4c23-9fea-f7dc89a5edf7</entry>
Apr 17 10:41:01 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:41:01 user nova-compute[82522]:     </system>
Apr 17 10:41:01 user nova-compute[82522]:   </sysinfo>
Apr 17 10:41:01 user nova-compute[82522]:   <os>
Apr 17 10:41:01 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:41:01 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:41:01 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:41:01 user nova-compute[82522]:   </os>
Apr 17 10:41:01 user nova-compute[82522]:   <features>
Apr 17 10:41:01 user nova-compute[82522]:     <acpi/>
Apr 17 10:41:01 user nova-compute[82522]:     <apic/>
Apr 17 10:41:01 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:41:01 user nova-compute[82522]:   </features>
Apr 17 10:41:01 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:41:01 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:41:01 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:41:01 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:41:01 user nova-compute[82522]:   </clock>
Apr 17 10:41:01 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:41:01 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:41:01 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:41:01 user nova-compute[82522]:   </cpu>
Apr 17 10:41:01 user nova-compute[82522]:   <devices>
Apr 17 10:41:01 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:41:01 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:41:01 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk"/>
Apr 17 10:41:01 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:41:01 user nova-compute[82522]:     </disk>
Apr 17 10:41:01 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:41:01 user nova-compute[82522]:       <mac address="fa:16:3e:48:83:0d"/>
Apr 17 10:41:01 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:41:01 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:41:01 user nova-compute[82522]:       <target dev="tap6fac7ecb-de"/>
Apr 17 10:41:01 user nova-compute[82522]:     </interface>
Apr 17 10:41:01 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:41:01 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/console.log" append="off"/>
Apr 17 10:41:01 user nova-compute[82522]:     </serial>
Apr 17 10:41:01 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:41:01 user nova-compute[82522]:     <video>
Apr 17 10:41:01 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:41:01 user nova-compute[82522]:     </video>
Apr 17 10:41:01 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:41:01 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:41:01 user nova-compute[82522]:     </rng>
Apr 17 10:41:01 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:41:01 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:41:01 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:41:01 user nova-compute[82522]:     </memballoon>
Apr 17 10:41:01 user nova-compute[82522]:   </devices>
Apr 17 10:41:01 user nova-compute[82522]: </domain>
Apr 17 10:41:01 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-452716688',display_name='tempest-ServersNegativeTestJSON-server-452716688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-452716688',id=16,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b831c3b6c244dda1821583a6b8cd08',ramdisk_id='',reservation_id='r-00pg4w34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-812869679',owner_user_name='tempest-ServersNegativeTestJSON-812869679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:40:58Z,user_data=None,user_id='1e61a5e172c34636b183ef9c84b714d8',uuid=b0a9753b-207e-4c23-9fea-f7dc89a5edf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converting VIF {"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:83:0d,bridge_name='br-int',has_traffic_filtering=True,id=6fac7ecb-de62-4a89-b509-210fa4bedd43,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fac7ecb-de') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG os_vif [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:83:0d,bridge_name='br-int',has_traffic_filtering=True,id=6fac7ecb-de62-4a89-b509-210fa4bedd43,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fac7ecb-de') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fac7ecb-de, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fac7ecb-de, col_values=(('external_ids', {'iface-id': '6fac7ecb-de62-4a89-b509-210fa4bedd43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:83:0d', 'vm-uuid': 'b0a9753b-207e-4c23-9fea-f7dc89a5edf7'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:01 user nova-compute[82522]: INFO os_vif [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:83:0d,bridge_name='br-int',has_traffic_filtering=True,id=6fac7ecb-de62-4a89-b509-210fa4bedd43,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fac7ecb-de')
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] No VIF found with MAC fa:16:3e:48:83:0d, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:01 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Deleted allocations for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597
Apr 17 10:41:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.488s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.network.neutron [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Updated VIF entry in instance network info cache for port 6fac7ecb-de62-4a89-b509-210fa4bedd43. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.network.neutron [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Updating instance_info_cache with network_info: [{"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] Releasing lock "refresh_cache-b0a9753b-207e-4c23-9fea-f7dc89a5edf7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:01 user nova-compute[82522]: INFO nova.compute.manager [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Detaching volume 6b225ba1-7dd8-420b-8e44-cae7e5b7a53b
Apr 17 10:41:01 user nova-compute[82522]: INFO nova.virt.block_device [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Attempting to driver detach volume 6b225ba1-7dd8-420b-8e44-cae7e5b7a53b from mountpoint /dev/vdb
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Attempting to detach device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:41:01 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:41:01 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:41:01 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:41:01 user nova-compute[82522]:   <serial>6b225ba1-7dd8-420b-8e44-cae7e5b7a53b</serial>
Apr 17 10:41:01 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:41:01 user nova-compute[82522]: </disk>
Apr 17 10:41:01 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:41:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully detached device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the persistent domain config.
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7792cf72-dc73-4201-9501-4515ce860735 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:41:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:41:01 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:41:01 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:41:01 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:41:01 user nova-compute[82522]:   <serial>6b225ba1-7dd8-420b-8e44-cae7e5b7a53b</serial>
Apr 17 10:41:01 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:41:01 user nova-compute[82522]: </disk>
Apr 17 10:41:01 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728062.4842572, 7792cf72-dc73-4201-9501-4515ce860735 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:41:02 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully detached device vdb from instance 7792cf72-dc73-4201-9501-4515ce860735 from the live domain config.
Apr 17 10:41:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMUwxcJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:41:02 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d471296c-096f-4ee2-98f1-99760de28c9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:41:02 user nova-compute[82522]: No targets found.
Apr 17 10:41:02 user nova-compute[82522]: iSNS:
Apr 17 10:41:02 user nova-compute[82522]: No targets found.
Apr 17 10:41:02 user nova-compute[82522]: STATIC:
Apr 17 10:41:02 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:41:02 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:41:02 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:41:02 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:41:02 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:41:02 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:41:02 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:41:02 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:41:02 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:41:02 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b
Apr 17 10:41:02 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:41:02 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:41:02 user nova-compute[82522]: FIRMWARE:
Apr 17 10:41:02 user nova-compute[82522]: No targets found.
Apr 17 10:41:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:41:02 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:41:02 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8932fe-0f3e-475e-8191-c3bd7995b9db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6944b063-89fc-4706-892b-7cd058be0847]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:41:02 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:41:02 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:41:02 user nova-compute[82522]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b (non-flash)
Apr 17 10:41:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:41:02 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:41:02 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:41:02 user nova-compute[82522]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b (non-flash)
Apr 17 10:41:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2846103a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b'): ({'sdc'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Removing single pathed devices sdc {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9b6513-9b3e-4de6-9541-2ee3129cd73e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f763c7d6-53f9-4488-ab1d-e8037373b091]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Flushing IO for device /dev/sdc {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-097187bf-082e-4fb3-9fb1-f6a4ea112f78 req-ccca5bb4-a056-42e6-898e-08755036794f service nova] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Received event network-vif-deleted-3106e21d-664e-4c17-85be-f0a654c4eabc {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[48090efe-457d-4caa-90bf-8fd1fa2a38fd]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a770c6e-370b-4373-bfc4-6f0f14a329c0]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b11fa42-e43f-4fde-a5b0-d72fe96a9b05]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce48e006-0e36-4ac8-87b1-563c11586eeb]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b, portal: 172.16.0.220,3260]
Apr 17 10:41:02 user nova-compute[82522]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b, portal: 172.16.0.220,3260] successful.
Apr 17 10:41:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b225ba1-7dd8-420b-8e44-cae7e5b7a53b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a85311-c484-4a7b-82b9-4e76468ac906]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] <== disconnect_volume: return (324ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received event network-vif-plugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] Acquiring lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] No waiting events found dispatching network-vif-plugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:41:03 user nova-compute[82522]: WARNING nova.compute.manager [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received unexpected event network-vif-plugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance with vm_state building and task_state spawning.
Apr 17 10:41:03 user nova-compute[82522]: DEBUG nova.objects.instance [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'flavor' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:41:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.906s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728065.0155241, b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:41:05 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] VM Resumed (Lifecycle Event)
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:41:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Instance spawned successfully.
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:05 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728065.0170352, b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:41:05 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] VM Started (Lifecycle Event)
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:41:05 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:41:05 user nova-compute[82522]: INFO nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Took 7.27 seconds to spawn the instance on the hypervisor.
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received event network-vif-plugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] Acquiring lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] No waiting events found dispatching network-vif-plugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:41:05 user nova-compute[82522]: WARNING nova.compute.manager [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received unexpected event network-vif-plugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance with vm_state building and task_state spawning.
Apr 17 10:41:05 user nova-compute[82522]: INFO nova.compute.manager [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Took 8.01 seconds to build instance.
Apr 17 10:41:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.106s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:09 user nova-compute[82522]: INFO nova.compute.manager [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Detaching volume bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:09 user nova-compute[82522]: INFO nova.compute.manager [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Terminating instance
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:41:09 user nova-compute[82522]: INFO nova.virt.block_device [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Attempting to driver detach volume bdf94f31-0fa3-4682-abb5-161b0e318367 from mountpoint /dev/vdb
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Attempting to detach device vdb from instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:41:09 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:41:09 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:41:09 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:41:09 user nova-compute[82522]:   <serial>bdf94f31-0fa3-4682-abb5-161b0e318367</serial>
Apr 17 10:41:09 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:41:09 user nova-compute[82522]: </disk>
Apr 17 10:41:09 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:41:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Successfully detached device vdb from instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 from the persistent domain config.
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:41:09 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:41:09 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:41:09 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:41:09 user nova-compute[82522]:   <serial>bdf94f31-0fa3-4682-abb5-161b0e318367</serial>
Apr 17 10:41:09 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:41:09 user nova-compute[82522]: </disk>
Apr 17 10:41:09 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-unplugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] No waiting events found dispatching network-vif-unplugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-unplugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728069.8190281, e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:41:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Successfully detached device vdb from instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 from the live domain config.
Apr 17 10:41:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaVRPKep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:41:09 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d87ea91-81e7-4bfb-ad1b-651498603047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:41:09 user nova-compute[82522]: No targets found.
Apr 17 10:41:09 user nova-compute[82522]: iSNS:
Apr 17 10:41:09 user nova-compute[82522]: No targets found.
Apr 17 10:41:09 user nova-compute[82522]: STATIC:
Apr 17 10:41:09 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367
Apr 17 10:41:09 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:41:09 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:41:09 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:41:09 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:41:09 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:41:09 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:41:09 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:41:09 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:41:09 user nova-compute[82522]: FIRMWARE:
Apr 17 10:41:09 user nova-compute[82522]: No targets found.
Apr 17 10:41:09 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:41:09 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:41:09 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da07e91-7726-4c9c-9a06-bea3986490b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af32ae7-f7d5-467f-bd0b-4c2d72a219c3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:41:09 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:41:09 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:41:09 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:41:09 user nova-compute[82522]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 (non-flash)
Apr 17 10:41:09 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:41:09 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2844df130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367'): ({'sdd'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Removing single pathed devices sdd {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6b78b9-da8c-411f-b95f-a27a9ac64982]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2e3a4-7161-4d14-86ef-b1b7c576f808]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Flushing IO for device /dev/sdd {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbf888b-e2d5-4569-9b1d-4f880fc7bdf6]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.081s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[422fa99d-05d5-4cca-b02c-b5d09310a21f]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2361a0e-2f5c-4a01-af4b-38a3dd11c41c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966db53-076a-40b6-8a8e-2903fa4ede7d]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367, portal: 172.16.0.220,3260]
Apr 17 10:41:10 user nova-compute[82522]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367, portal: 172.16.0.220,3260] successful.
Apr 17 10:41:10 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf94f31-0fa3-4682-abb5-161b0e318367 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af477d6-7350-46c3-b5c7-5ba8b4428494]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] <== disconnect_volume: return (385ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:41:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Instance destroyed successfully.
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'resources' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 60008675-7786-4a26-9640-49da6efd0adb {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 5e03807e-942b-4155-835b-b1c86f5b80f5 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid b0a9753b-207e-4c23-9fea-f7dc89a5edf7 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "60008675-7786-4a26-9640-49da6efd0adb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "60008675-7786-4a26-9640-49da6efd0adb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-146173286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-146173286',id=4,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnvtiDTDPjiz0hQ6df6omtPSqLx8cphP5uhCzg3kQ4E0fo/fGmWEtXCk0ZdSSLB3uDiMb6lTel263kG9OXq4VKHzNS8Ca9hU4viwWvpL2VficVcm9xF14aNByKdknbl9g==',key_name='tempest-keypair-850060525',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-llggnnwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:38:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=c4315753-415c-45cd-b06f-da1e3ccc6e4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "address": "fa:16:3e:74:83:7c", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd279a0c-99", "ovs_interfaceid": "cd279a0c-99eb-4e32-876e-6d2208cc1db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG os_vif [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd279a0c-99, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:10 user nova-compute[82522]: INFO os_vif [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:83:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd279a0c-99eb-4e32-876e-6d2208cc1db2,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd279a0c-99')
Apr 17 10:41:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Deleting instance files /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d_del
Apr 17 10:41:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Deletion of /opt/stack/data/nova/instances/c4315753-415c-45cd-b06f-da1e3ccc6e4d_del complete
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "60008675-7786-4a26-9640-49da6efd0adb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:10 user nova-compute[82522]: INFO nova.compute.manager [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 17 10:41:10 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:41:10 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG nova.objects.instance [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'flavor' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.933s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.834s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:41:11 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Took 0.85 seconds to deallocate network for instance.
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] Acquiring lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] No waiting events found dispatching network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:41:11 user nova-compute[82522]: WARNING nova.compute.manager [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received unexpected event network-vif-plugged-cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance with vm_state deleted and task_state None.
Apr 17 10:41:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Received event network-vif-deleted-cd279a0c-99eb-4e32-876e-6d2208cc1db2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:11 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Deleted allocations for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.579s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.517s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:11 user nova-compute[82522]: INFO nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 17 10:41:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "c4315753-415c-45cd-b06f-da1e3ccc6e4d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:13 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728058.815089, 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:41:13 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] VM Stopped (Lifecycle Event)
Apr 17 10:41:13 user nova-compute[82522]: DEBUG nova.compute.manager [None req-8be88729-e7df-462c-a1de-25c949619550 None None] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:41:15 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [{"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:41:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:22 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:41:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728070.2833915, c4315753-415c-45cd-b06f-da1e3ccc6e4d => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:41:25 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] VM Stopped (Lifecycle Event)
Apr 17 10:41:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-08e08ae1-e7d5-457b-8e27-efb9b65f3a31 None None] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:25 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:41:25 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:41:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=7865MB free_disk=26.43206787109375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 59fd26de-d46e-4f41-91f6-090005a07d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 7792cf72-dc73-4201-9501-4515ce860735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:41:26 user nova-compute[82522]: INFO nova.compute.claims [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Claim successful on node user
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.network.neutron [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:41:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.policy [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f69d4d16a4bc479ba2a8a80f359135f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33eedb851ee244768016f5bf203d2f9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:41:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Creating image(s)
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "/opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "/opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "/opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk 1073741824" returned: 0 in 0.063s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:41:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Cannot resize image /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG nova.objects.instance [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'migration_context' on Instance uuid 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Successfully created port: bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Ensure instance console log exists: /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Successfully updated port: bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "refresh_cache-57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquired lock "refresh_cache-57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received event network-changed-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Refreshing instance network info cache due to event network-changed-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] Acquiring lock "refresh_cache-57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Updating instance_info_cache with network_info: [{"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Releasing lock "refresh_cache-57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Instance network_info: |[{"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] Acquired lock "refresh_cache-57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Refreshing network info cache for port bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Start _get_guest_xml network_info=[{"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:41:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:41:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1128777175',display_name='tempest-VolumesAdminNegativeTest-server-1128777175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1128777175',id=17,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33eedb851ee244768016f5bf203d2f9f',ramdisk_id='',reservation_id='r-w8q3cs1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1835927457',owner_user_name='tempest-VolumesAdminNegativeTest-1835927457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:41:27Z,user_data=None,user_id='f69d4d16a4bc479ba2a8a80f359135f7',uuid=57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converting VIF {"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:79:e5,bridge_name='br-int',has_traffic_filtering=True,id=bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce56f65-9c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.objects.instance [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'pci_devices' on Instance uuid 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:41:29 user nova-compute[82522]:   <uuid>57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4</uuid>
Apr 17 10:41:29 user nova-compute[82522]:   <name>instance-00000011</name>
Apr 17 10:41:29 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:41:29 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:41:29 user nova-compute[82522]:   <metadata>
Apr 17 10:41:29 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:41:29 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:41:29 user nova-compute[82522]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1128777175</nova:name>
Apr 17 10:41:29 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:41:29</nova:creationTime>
Apr 17 10:41:29 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:41:29 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:41:29 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:41:29 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:41:29 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:41:29 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:41:29 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:41:29 user nova-compute[82522]:       <nova:owner>
Apr 17 10:41:29 user nova-compute[82522]:         <nova:user uuid="f69d4d16a4bc479ba2a8a80f359135f7">tempest-VolumesAdminNegativeTest-1835927457-project-member</nova:user>
Apr 17 10:41:29 user nova-compute[82522]:         <nova:project uuid="33eedb851ee244768016f5bf203d2f9f">tempest-VolumesAdminNegativeTest-1835927457</nova:project>
Apr 17 10:41:29 user nova-compute[82522]:       </nova:owner>
Apr 17 10:41:29 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:41:29 user nova-compute[82522]:       <nova:ports>
Apr 17 10:41:29 user nova-compute[82522]:         <nova:port uuid="bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f">
Apr 17 10:41:29 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 10:41:29 user nova-compute[82522]:         </nova:port>
Apr 17 10:41:29 user nova-compute[82522]:       </nova:ports>
Apr 17 10:41:29 user nova-compute[82522]:     </nova:instance>
Apr 17 10:41:29 user nova-compute[82522]:   </metadata>
Apr 17 10:41:29 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:41:29 user nova-compute[82522]:     <system>
Apr 17 10:41:29 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:41:29 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:41:29 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:41:29 user nova-compute[82522]:       <entry name="serial">57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4</entry>
Apr 17 10:41:29 user nova-compute[82522]:       <entry name="uuid">57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4</entry>
Apr 17 10:41:29 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:41:29 user nova-compute[82522]:     </system>
Apr 17 10:41:29 user nova-compute[82522]:   </sysinfo>
Apr 17 10:41:29 user nova-compute[82522]:   <os>
Apr 17 10:41:29 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:41:29 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:41:29 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:41:29 user nova-compute[82522]:   </os>
Apr 17 10:41:29 user nova-compute[82522]:   <features>
Apr 17 10:41:29 user nova-compute[82522]:     <acpi/>
Apr 17 10:41:29 user nova-compute[82522]:     <apic/>
Apr 17 10:41:29 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:41:29 user nova-compute[82522]:   </features>
Apr 17 10:41:29 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:41:29 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:41:29 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:41:29 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:41:29 user nova-compute[82522]:   </clock>
Apr 17 10:41:29 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:41:29 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:41:29 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:41:29 user nova-compute[82522]:   </cpu>
Apr 17 10:41:29 user nova-compute[82522]:   <devices>
Apr 17 10:41:29 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:41:29 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:41:29 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk"/>
Apr 17 10:41:29 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:41:29 user nova-compute[82522]:     </disk>
Apr 17 10:41:29 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:41:29 user nova-compute[82522]:       <mac address="fa:16:3e:5c:79:e5"/>
Apr 17 10:41:29 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:41:29 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:41:29 user nova-compute[82522]:       <target dev="tapbce56f65-9c"/>
Apr 17 10:41:29 user nova-compute[82522]:     </interface>
Apr 17 10:41:29 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:41:29 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/console.log" append="off"/>
Apr 17 10:41:29 user nova-compute[82522]:     </serial>
Apr 17 10:41:29 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:41:29 user nova-compute[82522]:     <video>
Apr 17 10:41:29 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:41:29 user nova-compute[82522]:     </video>
Apr 17 10:41:29 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:41:29 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:41:29 user nova-compute[82522]:     </rng>
Apr 17 10:41:29 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:41:29 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:41:29 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:41:29 user nova-compute[82522]:     </memballoon>
Apr 17 10:41:29 user nova-compute[82522]:   </devices>
Apr 17 10:41:29 user nova-compute[82522]: </domain>
Apr 17 10:41:29 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1128777175',display_name='tempest-VolumesAdminNegativeTest-server-1128777175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1128777175',id=17,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33eedb851ee244768016f5bf203d2f9f',ramdisk_id='',reservation_id='r-w8q3cs1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1835927457',owner_user_name='tempest-VolumesAdminNegativeTest-1835927457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:41:27Z,user_data=None,user_id='f69d4d16a4bc479ba2a8a80f359135f7',uuid=57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converting VIF {"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:79:e5,bridge_name='br-int',has_traffic_filtering=True,id=bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce56f65-9c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG os_vif [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:79:e5,bridge_name='br-int',has_traffic_filtering=True,id=bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce56f65-9c') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbce56f65-9c, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbce56f65-9c, col_values=(('external_ids', {'iface-id': 'bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:79:e5', 'vm-uuid': '57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:29 user nova-compute[82522]: INFO os_vif [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:79:e5,bridge_name='br-int',has_traffic_filtering=True,id=bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce56f65-9c')
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:41:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] No VIF found with MAC fa:16:3e:5c:79:e5, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:41:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Updated VIF entry in instance network info cache for port bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:41:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Updating instance_info_cache with network_info: [{"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:41:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] Releasing lock "refresh_cache-57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:41:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received event network-vif-plugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] Acquiring lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] No waiting events found dispatching network-vif-plugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:41:31 user nova-compute[82522]: WARNING nova.compute.manager [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received unexpected event network-vif-plugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance with vm_state building and task_state spawning.
Apr 17 10:41:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728093.0631263, 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:41:33 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] VM Resumed (Lifecycle Event)
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:41:33 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Instance spawned successfully.
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:41:33 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728093.066148, 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:41:33 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] VM Started (Lifecycle Event)
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:41:33 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:41:33 user nova-compute[82522]: INFO nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Took 5.77 seconds to spawn the instance on the hypervisor.
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:41:33 user nova-compute[82522]: INFO nova.compute.manager [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Took 6.49 seconds to build instance.
Apr 17 10:41:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.586s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received event network-vif-plugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] Acquiring lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:41:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] No waiting events found dispatching network-vif-plugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:41:33 user nova-compute[82522]: WARNING nova.compute.manager [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received unexpected event network-vif-plugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance with vm_state active and task_state None.
Apr 17 10:41:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:41:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:41:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:41:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:41:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:41:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:41:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:41:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:41:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:41:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:41:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:00 user nova-compute[82522]: INFO nova.compute.manager [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Unrescuing
Apr 17 10:42:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:42:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquired lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:42:00 user nova-compute[82522]: DEBUG nova.network.neutron [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing instance network info cache due to event network-changed-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] Acquiring lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] Acquired lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG nova.network.neutron [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Refreshing network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:01 user nova-compute[82522]: INFO nova.compute.manager [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Terminating instance
Apr 17 10:42:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG nova.network.neutron [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating instance_info_cache with network_info: [{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Releasing lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG nova.objects.instance [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'flavor' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.network.neutron [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updated VIF entry in instance network info cache for port 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.network.neutron [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [{"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] Releasing lock "refresh_cache-b0c707ac-b08f-4f18-8262-e1b79d7e17e1" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-unplugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] No waiting events found dispatching network-vif-unplugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-unplugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:42:02 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Instance destroyed successfully.
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.objects.instance [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lazy-loading 'resources' on Instance uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-906009009',display_name='tempest-TestShelveInstance-server-906009009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-906009009',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH4FFXKqH+g7k0ASGnNDXfUy/R1u6icWp+zf9vlgtMbomh5J54TN/pK57/PFpeGZBHXgpMBfbuezVh6SWpKdljIUuRGib6lK5tHsF/MEgxDHkpa84AcMmldHwjGud+ZtQ==',key_name='tempest-TestShelveInstance-993329906',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:40:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a793afb3e7045898c59a77975079d72',ramdisk_id='',reservation_id='r-g168xrnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2028370832',owner_user_name='tempest-TestShelveInstance-2028370832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:40:26Z,user_data=None,user_id='b43c0aee7b05459d898e0dc2654262fa',uuid=b0c707ac-b08f-4f18-8262-e1b79d7e17e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converting VIF {"id": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "address": "fa:16:3e:c4:70:05", "network": {"id": "68557115-4630-4346-b494-d569a7bf3e75", "bridge": "br-int", "label": "tempest-TestShelveInstance-1026016459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a793afb3e7045898c59a77975079d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c85bb7-50", "ovs_interfaceid": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_vif [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90c85bb7-50, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:02 user nova-compute[82522]: INFO os_vif [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:70:05,bridge_name='br-int',has_traffic_filtering=True,id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3,network=Network(68557115-4630-4346-b494-d569a7bf3e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c85bb7-50')
Apr 17 10:42:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amnpFeIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:42:02 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:02 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Instance destroyed successfully.
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba6a0d7-6c98-4569-9de9-e3defb7ccfe3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:42:02 user nova-compute[82522]: No targets found.
Apr 17 10:42:02 user nova-compute[82522]: iSNS:
Apr 17 10:42:02 user nova-compute[82522]: No targets found.
Apr 17 10:42:02 user nova-compute[82522]: STATIC:
Apr 17 10:42:02 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:42:02 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:42:02 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:42:02 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970
Apr 17 10:42:02 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:42:02 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:42:02 user nova-compute[82522]: FIRMWARE:
Apr 17 10:42:02 user nova-compute[82522]: No targets found.
Apr 17 10:42:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:42:02 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:42:02 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37c23b6-6398-440f-8ed2-f8f90ac590fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f329fe-ec5b-43cb-bf1c-c5739ab02ff3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:42:02 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:42:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:42:02 user nova-compute[82522]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 (non-flash)
Apr 17 10:42:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2a471e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970'): ({'sde'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Removing single pathed devices sde {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[61db711f-08d3-44eb-a452-0e915662e9a4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee677c3-2adf-4dd8-b853-16a11d19f391]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Flushing IO for device /dev/sde {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e051ab04-5481-4269-9edb-5701be79a101]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed86f57a-d0b8-45c4-8a29-2e44e6abc378]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f9d5c45d', '/dev/disk/by-id/scsi-1SCST_BIOf9d5c45d-51df0eb910f3cc34', '/dev/disk/by-id/scsi-23531646630656239') {{(pid=92652) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 17 10:42:02 user nova-compute[82522]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f9d5c45d
Apr 17 10:42:02 user nova-compute[82522]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf9d5c45d-51df0eb910f3cc34
Apr 17 10:42:02 user nova-compute[82522]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23531646630656239
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[27572742-859a-4f09-97fd-c7f23b6415c2]: (4, None) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c983475-20f1-4e3b-bcaa-646497c2b771]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:42:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[54541191-9990-47dc-9c47-02722aafb5d8]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260]
Apr 17 10:42:03 user nova-compute[82522]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970, portal: 172.16.0.220,3260] successful.
Apr 17 10:42:03 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32955c44-ba4e-4422-bebe-32b68bb7b970 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f07ea12-9e65-4693-abda-29af42977d1e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] <== disconnect_volume: return (386ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:42:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Deleting instance files /opt/stack/data/nova/instances/b0c707ac-b08f-4f18-8262-e1b79d7e17e1_del
Apr 17 10:42:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Deletion of /opt/stack/data/nova/instances/b0c707ac-b08f-4f18-8262-e1b79d7e17e1_del complete
Apr 17 10:42:03 user nova-compute[82522]: INFO nova.compute.manager [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Took 1.64 seconds to destroy the instance on the hypervisor.
Apr 17 10:42:03 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:03 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Took 0.78 seconds to deallocate network for instance.
Apr 17 10:42:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-deleted-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:03 user nova-compute[82522]: INFO nova.compute.manager [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Neutron deleted interface 90c85bb7-50e1-4c86-9c1f-e27f14fb50d3; detaching it from the instance and deleting it from the info cache
Apr 17 10:42:03 user nova-compute[82522]: DEBUG nova.network.neutron [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Detach interface failed, port_id=90c85bb7-50e1-4c86-9c1f-e27f14fb50d3, reason: Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Acquiring lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] No waiting events found dispatching network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:04 user nova-compute[82522]: WARNING nova.compute.manager [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Received unexpected event network-vif-plugged-90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance with vm_state active and task_state deleting.
Apr 17 10:42:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:04 user nova-compute[82522]: WARNING nova.compute.manager [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:42:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:04 user nova-compute[82522]: WARNING nova.compute.manager [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:42:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:04 user nova-compute[82522]: INFO nova.compute.manager [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Terminating instance
Apr 17 10:42:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:04 user nova-compute[82522]: INFO nova.compute.manager [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Took 1.01 seconds to detach 1 volumes for instance.
Apr 17 10:42:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Deleting volume: 32955c44-ba4e-4422-bebe-32b68bb7b970 {{(pid=82522) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:42:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Instance destroyed successfully.
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'resources' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-149216570',display_name='tempest-ServerStableDeviceRescueTest-server-149216570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-149216570',id=5,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMwn+C+1/WvqV85P8Z+0YbdwvuPA1JRVCsTkMku5wTk3lWyccqRP3BA+GEJxUJW41c3kbKZgFZYKS36Yqqk/bayBcZoFHQqGTKsw0QCKdBNYqIi+SXQR7Q9/idwCJCSQQ==',key_name='tempest-keypair-690522544',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850462faec874544bdc01dd14746d558',ramdisk_id='',reservation_id='r-rmln8x19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1756156966',owner_user_name='tempest-ServerStableDeviceRescueTest-1756156966-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:40:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='282298df65264595b5d7351066128b1a',uuid=e0b1074e-7352-437a-b2ec-1eaefc5bf1b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Converting VIF {"id": "f839dea5-4294-4842-bfa2-262351dabfb9", "address": "fa:16:3e:59:c9:94", "network": {"id": "95203f9a-7934-486d-b36d-13d2317f1102", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1377986057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850462faec874544bdc01dd14746d558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf839dea5-42", "ovs_interfaceid": "f839dea5-4294-4842-bfa2-262351dabfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:c9:94,bridge_name='br-int',has_traffic_filtering=True,id=f839dea5-4294-4842-bfa2-262351dabfb9,network=Network(95203f9a-7934-486d-b36d-13d2317f1102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf839dea5-42') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG os_vif [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:c9:94,bridge_name='br-int',has_traffic_filtering=True,id=f839dea5-4294-4842-bfa2-262351dabfb9,network=Network(95203f9a-7934-486d-b36d-13d2317f1102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf839dea5-42') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf839dea5-42, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:05 user nova-compute[82522]: INFO os_vif [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:c9:94,bridge_name='br-int',has_traffic_filtering=True,id=f839dea5-4294-4842-bfa2-262351dabfb9,network=Network(95203f9a-7934-486d-b36d-13d2317f1102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf839dea5-42')
Apr 17 10:42:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Deleting instance files /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4_del
Apr 17 10:42:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Deletion of /opt/stack/data/nova/instances/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4_del complete
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:05 user nova-compute[82522]: INFO nova.compute.manager [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.372s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:42:05 user nova-compute[82522]: INFO nova.compute.claims [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Claim successful on node user
Apr 17 10:42:05 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Deleted allocations for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "b0c707ac-b08f-4f18-8262-e1b79d7e17e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.273s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-unplugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Acquiring lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] No waiting events found dispatching network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:05 user nova-compute[82522]: WARNING nova.compute.manager [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received unexpected event network-vif-plugged-f839dea5-4294-4842-bfa2-262351dabfb9 for instance with vm_state active and task_state deleting.
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:42:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:42:06 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Took 0.89 seconds to deallocate network for instance.
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:06 user nova-compute[82522]: WARNING nova.compute.manager [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:06 user nova-compute[82522]: WARNING nova.compute.manager [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.policy [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:42:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Creating image(s)
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728126.5177987, 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] VM Resumed (Lifecycle Event)
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.174s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728126.5182114, 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] VM Started (Lifecycle Event)
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk 1073741824" returned: 0 in 0.070s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.650s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:42:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:07 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Deleted allocations for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4
Apr 17 10:42:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Successfully created port: 8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.781s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Cannot resize image /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'migration_context' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Ensure instance console log exists: /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Successfully updated port: 8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquired lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:42:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Received event network-vif-deleted-f839dea5-4294-4842-bfa2-262351dabfb9 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-changed-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Refreshing instance network info cache due to event network-changed-8541d98c-fcb7-4f1a-904c-97db8145dd29. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] Acquiring lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updating instance_info_cache with network_info: [{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Releasing lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance network_info: |[{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] Acquired lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Refreshing network info cache for port 8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Start _get_guest_xml network_info=[{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:42:08 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:42:08 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486235308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486235308',id=18,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDukjSLeCue+jobK7F8+eqUod8S/SPwFRRjU948hgPTGwDtheEfK10Qt0k7bGB9RgcPDrWEuC4lYGOl33GS6HRjNgrGZR1aDCH1PVL2Qkt1O7P4VtYS1j0HHPoUkaMdtKQ==',key_name='tempest-keypair-1963349943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-nhvcv880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=288bc9dc-1698-4ca9-a670-5e219c04202b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'pci_devices' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:42:08 user nova-compute[82522]:   <uuid>288bc9dc-1698-4ca9-a670-5e219c04202b</uuid>
Apr 17 10:42:08 user nova-compute[82522]:   <name>instance-00000012</name>
Apr 17 10:42:08 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:42:08 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:42:08 user nova-compute[82522]:   <metadata>
Apr 17 10:42:08 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:42:08 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:42:08 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1486235308</nova:name>
Apr 17 10:42:08 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:42:08</nova:creationTime>
Apr 17 10:42:08 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:42:08 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:42:08 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:42:08 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:42:08 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:42:08 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:42:08 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:42:08 user nova-compute[82522]:       <nova:owner>
Apr 17 10:42:08 user nova-compute[82522]:         <nova:user uuid="aea97828312f45ffa1b7148c375a7f9a">tempest-AttachVolumeShelveTestJSON-1174346715-project-member</nova:user>
Apr 17 10:42:08 user nova-compute[82522]:         <nova:project uuid="e6dac880f4294283ae7838bfa0edf5c1">tempest-AttachVolumeShelveTestJSON-1174346715</nova:project>
Apr 17 10:42:08 user nova-compute[82522]:       </nova:owner>
Apr 17 10:42:08 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:42:08 user nova-compute[82522]:       <nova:ports>
Apr 17 10:42:08 user nova-compute[82522]:         <nova:port uuid="8541d98c-fcb7-4f1a-904c-97db8145dd29">
Apr 17 10:42:08 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 17 10:42:08 user nova-compute[82522]:         </nova:port>
Apr 17 10:42:08 user nova-compute[82522]:       </nova:ports>
Apr 17 10:42:08 user nova-compute[82522]:     </nova:instance>
Apr 17 10:42:08 user nova-compute[82522]:   </metadata>
Apr 17 10:42:08 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:42:08 user nova-compute[82522]:     <system>
Apr 17 10:42:08 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:42:08 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:42:08 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:42:08 user nova-compute[82522]:       <entry name="serial">288bc9dc-1698-4ca9-a670-5e219c04202b</entry>
Apr 17 10:42:08 user nova-compute[82522]:       <entry name="uuid">288bc9dc-1698-4ca9-a670-5e219c04202b</entry>
Apr 17 10:42:08 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:42:08 user nova-compute[82522]:     </system>
Apr 17 10:42:08 user nova-compute[82522]:   </sysinfo>
Apr 17 10:42:08 user nova-compute[82522]:   <os>
Apr 17 10:42:08 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:42:08 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:42:08 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:42:08 user nova-compute[82522]:   </os>
Apr 17 10:42:08 user nova-compute[82522]:   <features>
Apr 17 10:42:08 user nova-compute[82522]:     <acpi/>
Apr 17 10:42:08 user nova-compute[82522]:     <apic/>
Apr 17 10:42:08 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:42:08 user nova-compute[82522]:   </features>
Apr 17 10:42:08 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:42:08 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:42:08 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:42:08 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:42:08 user nova-compute[82522]:   </clock>
Apr 17 10:42:08 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:42:08 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:42:08 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:42:08 user nova-compute[82522]:   </cpu>
Apr 17 10:42:08 user nova-compute[82522]:   <devices>
Apr 17 10:42:08 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:42:08 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:42:08 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk"/>
Apr 17 10:42:08 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:42:08 user nova-compute[82522]:     </disk>
Apr 17 10:42:08 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:42:08 user nova-compute[82522]:       <mac address="fa:16:3e:dc:2c:c6"/>
Apr 17 10:42:08 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:42:08 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:42:08 user nova-compute[82522]:       <target dev="tap8541d98c-fc"/>
Apr 17 10:42:08 user nova-compute[82522]:     </interface>
Apr 17 10:42:08 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:42:08 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/console.log" append="off"/>
Apr 17 10:42:08 user nova-compute[82522]:     </serial>
Apr 17 10:42:08 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:42:08 user nova-compute[82522]:     <video>
Apr 17 10:42:08 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:42:08 user nova-compute[82522]:     </video>
Apr 17 10:42:08 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:42:08 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:42:08 user nova-compute[82522]:     </rng>
Apr 17 10:42:08 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:42:08 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:42:08 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:42:08 user nova-compute[82522]:     </memballoon>
Apr 17 10:42:08 user nova-compute[82522]:   </devices>
Apr 17 10:42:08 user nova-compute[82522]: </domain>
Apr 17 10:42:08 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486235308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486235308',id=18,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDukjSLeCue+jobK7F8+eqUod8S/SPwFRRjU948hgPTGwDtheEfK10Qt0k7bGB9RgcPDrWEuC4lYGOl33GS6HRjNgrGZR1aDCH1PVL2Qkt1O7P4VtYS1j0HHPoUkaMdtKQ==',key_name='tempest-keypair-1963349943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-nhvcv880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=288bc9dc-1698-4ca9-a670-5e219c04202b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG os_vif [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8541d98c-fc, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8541d98c-fc, col_values=(('external_ids', {'iface-id': '8541d98c-fcb7-4f1a-904c-97db8145dd29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:2c:c6', 'vm-uuid': '288bc9dc-1698-4ca9-a670-5e219c04202b'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:08 user nova-compute[82522]: INFO os_vif [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc')
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] No VIF found with MAC fa:16:3e:dc:2c:c6, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updated VIF entry in instance network info cache for port 8541d98c-fcb7-4f1a-904c-97db8145dd29. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updating instance_info_cache with network_info: [{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] Releasing lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:42:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] No waiting events found dispatching network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:10 user nova-compute[82522]: WARNING nova.compute.manager [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received unexpected event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance with vm_state building and task_state spawning.
Apr 17 10:42:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:11 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728131.9778707, 288bc9dc-1698-4ca9-a670-5e219c04202b => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:11 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] VM Resumed (Lifecycle Event)
Apr 17 10:42:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:42:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:42:11 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance spawned successfully.
Apr 17 10:42:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:42:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728131.982681, 288bc9dc-1698-4ca9-a670-5e219c04202b => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] VM Started (Lifecycle Event)
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:42:12 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:42:12 user nova-compute[82522]: INFO nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] No waiting events found dispatching network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:12 user nova-compute[82522]: WARNING nova.compute.manager [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received unexpected event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance with vm_state building and task_state spawning.
Apr 17 10:42:12 user nova-compute[82522]: INFO nova.compute.manager [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Took 6.95 seconds to build instance.
Apr 17 10:42:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.083s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:13 user nova-compute[82522]: DEBUG nova.compute.manager [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-changed-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:13 user nova-compute[82522]: DEBUG nova.compute.manager [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Refreshing instance network info cache due to event network-changed-7d50333e-fed3-47d0-9aaf-bd1ab7238d62. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:42:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] Acquiring lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:42:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] Acquired lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:42:13 user nova-compute[82522]: DEBUG nova.network.neutron [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Refreshing network info cache for port 7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:42:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:14 user nova-compute[82522]: DEBUG nova.network.neutron [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updated VIF entry in instance network info cache for port 7d50333e-fed3-47d0-9aaf-bd1ab7238d62. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:42:14 user nova-compute[82522]: DEBUG nova.network.neutron [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating instance_info_cache with network_info: [{"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] Releasing lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquired lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'info_cache' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728122.6069589, b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:17 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] VM Stopped (Lifecycle Event)
Apr 17 10:42:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-72b8388b-afd4-4093-812c-3ac613ba7ac7 None None] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:17 user nova-compute[82522]: INFO nova.compute.manager [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Terminating instance
Apr 17 10:42:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-unplugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] No waiting events found dispatching network-vif-unplugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-unplugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updating instance_info_cache with network_info: [{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Releasing lock "refresh_cache-59fd26de-d46e-4f41-91f6-090005a07d99" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:42:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance destroyed successfully.
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'resources' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-92438997',display_name='tempest-AttachVolumeTestJSON-server-92438997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-92438997',id=3,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw==',key_name='tempest-keypair-1429660859',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-ip2vpwam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=59fd26de-d46e-4f41-91f6-090005a07d99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG os_vif [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7124043d-66, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: INFO os_vif [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66')
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Start _get_guest_xml network_info=[{"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'numa_topology' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:18 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:42:18 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'vcpu_model' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-92438997',display_name='tempest-AttachVolumeTestJSON-server-92438997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-92438997',id=3,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw==',key_name='tempest-keypair-1429660859',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-ip2vpwam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=59fd26de-d46e-4f41-91f6-090005a07d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'pci_devices' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:42:18 user nova-compute[82522]:   <uuid>59fd26de-d46e-4f41-91f6-090005a07d99</uuid>
Apr 17 10:42:18 user nova-compute[82522]:   <name>instance-00000003</name>
Apr 17 10:42:18 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:42:18 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:42:18 user nova-compute[82522]:   <metadata>
Apr 17 10:42:18 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:42:18 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:42:18 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeTestJSON-server-92438997</nova:name>
Apr 17 10:42:18 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:42:18</nova:creationTime>
Apr 17 10:42:18 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:42:18 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:42:18 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:42:18 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:42:18 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:42:18 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:42:18 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:42:18 user nova-compute[82522]:       <nova:owner>
Apr 17 10:42:18 user nova-compute[82522]:         <nova:user uuid="a9862432f87f4500a46f32a0b27d54d4">tempest-AttachVolumeTestJSON-2096000567-project-member</nova:user>
Apr 17 10:42:18 user nova-compute[82522]:         <nova:project uuid="6a17ec3e1b314acbb701f2d2d27d0560">tempest-AttachVolumeTestJSON-2096000567</nova:project>
Apr 17 10:42:18 user nova-compute[82522]:       </nova:owner>
Apr 17 10:42:18 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:42:18 user nova-compute[82522]:       <nova:ports>
Apr 17 10:42:18 user nova-compute[82522]:         <nova:port uuid="7124043d-665c-4a42-a041-b91ccc237b63">
Apr 17 10:42:18 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:42:18 user nova-compute[82522]:         </nova:port>
Apr 17 10:42:18 user nova-compute[82522]:       </nova:ports>
Apr 17 10:42:18 user nova-compute[82522]:     </nova:instance>
Apr 17 10:42:18 user nova-compute[82522]:   </metadata>
Apr 17 10:42:18 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:42:18 user nova-compute[82522]:     <system>
Apr 17 10:42:18 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:42:18 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:42:18 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:42:18 user nova-compute[82522]:       <entry name="serial">59fd26de-d46e-4f41-91f6-090005a07d99</entry>
Apr 17 10:42:18 user nova-compute[82522]:       <entry name="uuid">59fd26de-d46e-4f41-91f6-090005a07d99</entry>
Apr 17 10:42:18 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:42:18 user nova-compute[82522]:     </system>
Apr 17 10:42:18 user nova-compute[82522]:   </sysinfo>
Apr 17 10:42:18 user nova-compute[82522]:   <os>
Apr 17 10:42:18 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:42:18 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:42:18 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:42:18 user nova-compute[82522]:   </os>
Apr 17 10:42:18 user nova-compute[82522]:   <features>
Apr 17 10:42:18 user nova-compute[82522]:     <acpi/>
Apr 17 10:42:18 user nova-compute[82522]:     <apic/>
Apr 17 10:42:18 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:42:18 user nova-compute[82522]:   </features>
Apr 17 10:42:18 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:42:18 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:42:18 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:42:18 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:42:18 user nova-compute[82522]:   </clock>
Apr 17 10:42:18 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:42:18 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:42:18 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:42:18 user nova-compute[82522]:   </cpu>
Apr 17 10:42:18 user nova-compute[82522]:   <devices>
Apr 17 10:42:18 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:42:18 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:42:18 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk"/>
Apr 17 10:42:18 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:42:18 user nova-compute[82522]:     </disk>
Apr 17 10:42:18 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:42:18 user nova-compute[82522]:       <mac address="fa:16:3e:7f:75:70"/>
Apr 17 10:42:18 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:42:18 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:42:18 user nova-compute[82522]:       <target dev="tap7124043d-66"/>
Apr 17 10:42:18 user nova-compute[82522]:     </interface>
Apr 17 10:42:18 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:42:18 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/console.log" append="off"/>
Apr 17 10:42:18 user nova-compute[82522]:     </serial>
Apr 17 10:42:18 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:42:18 user nova-compute[82522]:     <video>
Apr 17 10:42:18 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:42:18 user nova-compute[82522]:     </video>
Apr 17 10:42:18 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:42:18 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:42:18 user nova-compute[82522]:     </rng>
Apr 17 10:42:18 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:42:18 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:42:18 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:42:18 user nova-compute[82522]:     </memballoon>
Apr 17 10:42:18 user nova-compute[82522]:   </devices>
Apr 17 10:42:18 user nova-compute[82522]: </domain>
Apr 17 10:42:18 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Instance destroyed successfully.
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'resources' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-3983057',display_name='tempest-SnapshotDataIntegrityTests-server-3983057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-3983057',id=8,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUy/ajstR9aQT2gkuOvucvRJeGg6vK7qK026KNm5Gtty8ym+LC1rRh/ZX81MNLHA7IhoKTr9dTq2LhqisMnOl79ug8UDsCxHekgGAl/F8lBsqTKCw+eY6QDhUlNTWsIWA==',key_name='tempest-SnapshotDataIntegrityTests-645097723',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:35:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df0c657dc95549a3a3ce94f35bfa91be',ramdisk_id='',reservation_id='r-8auanuyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1852888110',owner_user_name='tempest-SnapshotDataIntegrityTests-1852888110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:35:33Z,user_data=None,user_id='ea177954e75a45f7ad7c9831ab55375a',uuid=7792cf72-dc73-4201-9501-4515ce860735,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Converting VIF {"id": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "address": "fa:16:3e:f8:08:93", "network": {"id": "048217be-c7b8-4f65-a379-f4a8f0f18055", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-203920796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df0c657dc95549a3a3ce94f35bfa91be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d50333e-fe", "ovs_interfaceid": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:08:93,bridge_name='br-int',has_traffic_filtering=True,id=7d50333e-fed3-47d0-9aaf-bd1ab7238d62,network=Network(048217be-c7b8-4f65-a379-f4a8f0f18055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d50333e-fe') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG os_vif [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:08:93,bridge_name='br-int',has_traffic_filtering=True,id=7d50333e-fed3-47d0-9aaf-bd1ab7238d62,network=Network(048217be-c7b8-4f65-a379-f4a8f0f18055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d50333e-fe') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d50333e-fe, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:42:18 user nova-compute[82522]: INFO os_vif [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:08:93,bridge_name='br-int',has_traffic_filtering=True,id=7d50333e-fed3-47d0-9aaf-bd1ab7238d62,network=Network(048217be-c7b8-4f65-a379-f4a8f0f18055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d50333e-fe')
Apr 17 10:42:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Deleting instance files /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735_del
Apr 17 10:42:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Deletion of /opt/stack/data/nova/instances/7792cf72-dc73-4201-9501-4515ce860735_del complete
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:18 user nova-compute[82522]: INFO nova.compute.manager [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 7792cf72-dc73-4201-9501-4515ce860735] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'trusted_certs' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Cannot resize image /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'migration_context' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-92438997',display_name='tempest-AttachVolumeTestJSON-server-92438997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-92438997',id=3,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw==',key_name='tempest-keypair-1429660859',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-ip2vpwam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=59fd26de-d46e-4f41-91f6-090005a07d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG os_vif [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7124043d-66, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7124043d-66, col_values=(('external_ids', {'iface-id': '7124043d-665c-4a42-a041-b91ccc237b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:75:70', 'vm-uuid': '59fd26de-d46e-4f41-91f6-090005a07d99'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: INFO os_vif [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66')
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:19 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:19 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Took 1.10 seconds to deallocate network for instance.
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728125.1825397, e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:20 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] VM Stopped (Lifecycle Event)
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ab994c8a-b875-464c-9683-3c4e39032f35 None None] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] No waiting events found dispatching network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:20 user nova-compute[82522]: WARNING nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received unexpected event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance with vm_state deleted and task_state None.
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] No waiting events found dispatching network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:20 user nova-compute[82522]: WARNING nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received unexpected event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance with vm_state deleted and task_state None.
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] No waiting events found dispatching network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:20 user nova-compute[82522]: WARNING nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received unexpected event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance with vm_state deleted and task_state None.
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-unplugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] No waiting events found dispatching network-vif-unplugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:20 user nova-compute[82522]: WARNING nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received unexpected event network-vif-unplugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance with vm_state deleted and task_state None.
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Acquiring lock "7792cf72-dc73-4201-9501-4515ce860735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "7792cf72-dc73-4201-9501-4515ce860735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] No waiting events found dispatching network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:20 user nova-compute[82522]: WARNING nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received unexpected event network-vif-plugged-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance with vm_state deleted and task_state None.
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Received event network-vif-deleted-7d50333e-fed3-47d0-9aaf-bd1ab7238d62 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:20 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Deleted allocations for instance 7792cf72-dc73-4201-9501-4515ce860735
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-7792cf72-dc73-4201-9501-4515ce860735" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "7792cf72-dc73-4201-9501-4515ce860735" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.621s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:22 user nova-compute[82522]: WARNING nova.compute.manager [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state stopped and task_state powering-on.
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:22 user nova-compute[82522]: WARNING nova.compute.manager [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state stopped and task_state powering-on.
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728142.8717544, 59fd26de-d46e-4f41-91f6-090005a07d99 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:22 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] VM Resumed (Lifecycle Event)
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:42:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance rebooted successfully.
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:42:22 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728142.872061, 59fd26de-d46e-4f41-91f6-090005a07d99 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:22 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] VM Started (Lifecycle Event)
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:42:25 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:42:25 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:42:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=7943MB free_disk=26.50482940673828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:42:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 59fd26de-d46e-4f41-91f6-090005a07d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 288bc9dc-1698-4ca9-a670-5e219c04202b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:42:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "3e07a35c-b5cc-46df-8e83-21664fb83896" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:42:27 user nova-compute[82522]: INFO nova.compute.claims [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Claim successful on node user
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.network.neutron [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:42:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.policy [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae91492cb6f342f58e250622e2a3ac11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309bb2b37284020b81369ec89397374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:42:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Creating image(s)
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "/opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "/opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk 1073741824" returned: 0 in 0.057s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.156s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Successfully created port: bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Cannot resize image /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG nova.objects.instance [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lazy-loading 'migration_context' on Instance uuid 3e07a35c-b5cc-46df-8e83-21664fb83896 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Ensure instance console log exists: /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Successfully updated port: bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "refresh_cache-3e07a35c-b5cc-46df-8e83-21664fb83896" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquired lock "refresh_cache-3e07a35c-b5cc-46df-8e83-21664fb83896" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received event network-changed-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Refreshing instance network info cache due to event network-changed-bc335a40-eaf8-46de-a9fe-8bcd2052b126. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] Acquiring lock "refresh_cache-3e07a35c-b5cc-46df-8e83-21664fb83896" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:42:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Updating instance_info_cache with network_info: [{"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Releasing lock "refresh_cache-3e07a35c-b5cc-46df-8e83-21664fb83896" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Instance network_info: |[{"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] Acquired lock "refresh_cache-3e07a35c-b5cc-46df-8e83-21664fb83896" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Refreshing network info cache for port bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Start _get_guest_xml network_info=[{"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:42:30 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:42:30 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1133781509',display_name='tempest-VolumesActionsTest-instance-1133781509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1133781509',id=19,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b309bb2b37284020b81369ec89397374',ramdisk_id='',reservation_id='r-0i3kb0cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-505690119',owner_user_name='tempest-VolumesActionsTest-505690119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:42:28Z,user_data=None,user_id='ae91492cb6f342f58e250622e2a3ac11',uuid=3e07a35c-b5cc-46df-8e83-21664fb83896,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converting VIF {"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:71:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc335a40-eaf8-46de-a9fe-8bcd2052b126,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc335a40-ea') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.objects.instance [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e07a35c-b5cc-46df-8e83-21664fb83896 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:42:30 user nova-compute[82522]:   <uuid>3e07a35c-b5cc-46df-8e83-21664fb83896</uuid>
Apr 17 10:42:30 user nova-compute[82522]:   <name>instance-00000013</name>
Apr 17 10:42:30 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:42:30 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:42:30 user nova-compute[82522]:   <metadata>
Apr 17 10:42:30 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:42:30 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:42:30 user nova-compute[82522]:       <nova:name>tempest-VolumesActionsTest-instance-1133781509</nova:name>
Apr 17 10:42:30 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:42:30</nova:creationTime>
Apr 17 10:42:30 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:42:30 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:42:30 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:42:30 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:42:30 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:42:30 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:42:30 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:42:30 user nova-compute[82522]:       <nova:owner>
Apr 17 10:42:30 user nova-compute[82522]:         <nova:user uuid="ae91492cb6f342f58e250622e2a3ac11">tempest-VolumesActionsTest-505690119-project-member</nova:user>
Apr 17 10:42:30 user nova-compute[82522]:         <nova:project uuid="b309bb2b37284020b81369ec89397374">tempest-VolumesActionsTest-505690119</nova:project>
Apr 17 10:42:30 user nova-compute[82522]:       </nova:owner>
Apr 17 10:42:30 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:42:30 user nova-compute[82522]:       <nova:ports>
Apr 17 10:42:30 user nova-compute[82522]:         <nova:port uuid="bc335a40-eaf8-46de-a9fe-8bcd2052b126">
Apr 17 10:42:30 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 17 10:42:30 user nova-compute[82522]:         </nova:port>
Apr 17 10:42:30 user nova-compute[82522]:       </nova:ports>
Apr 17 10:42:30 user nova-compute[82522]:     </nova:instance>
Apr 17 10:42:30 user nova-compute[82522]:   </metadata>
Apr 17 10:42:30 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:42:30 user nova-compute[82522]:     <system>
Apr 17 10:42:30 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:42:30 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:42:30 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:42:30 user nova-compute[82522]:       <entry name="serial">3e07a35c-b5cc-46df-8e83-21664fb83896</entry>
Apr 17 10:42:30 user nova-compute[82522]:       <entry name="uuid">3e07a35c-b5cc-46df-8e83-21664fb83896</entry>
Apr 17 10:42:30 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:42:30 user nova-compute[82522]:     </system>
Apr 17 10:42:30 user nova-compute[82522]:   </sysinfo>
Apr 17 10:42:30 user nova-compute[82522]:   <os>
Apr 17 10:42:30 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:42:30 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:42:30 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:42:30 user nova-compute[82522]:   </os>
Apr 17 10:42:30 user nova-compute[82522]:   <features>
Apr 17 10:42:30 user nova-compute[82522]:     <acpi/>
Apr 17 10:42:30 user nova-compute[82522]:     <apic/>
Apr 17 10:42:30 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:42:30 user nova-compute[82522]:   </features>
Apr 17 10:42:30 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:42:30 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:42:30 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:42:30 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:42:30 user nova-compute[82522]:   </clock>
Apr 17 10:42:30 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:42:30 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:42:30 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:42:30 user nova-compute[82522]:   </cpu>
Apr 17 10:42:30 user nova-compute[82522]:   <devices>
Apr 17 10:42:30 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:42:30 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:42:30 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk"/>
Apr 17 10:42:30 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:42:30 user nova-compute[82522]:     </disk>
Apr 17 10:42:30 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:42:30 user nova-compute[82522]:       <mac address="fa:16:3e:42:71:0f"/>
Apr 17 10:42:30 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:42:30 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:42:30 user nova-compute[82522]:       <target dev="tapbc335a40-ea"/>
Apr 17 10:42:30 user nova-compute[82522]:     </interface>
Apr 17 10:42:30 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:42:30 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/console.log" append="off"/>
Apr 17 10:42:30 user nova-compute[82522]:     </serial>
Apr 17 10:42:30 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:42:30 user nova-compute[82522]:     <video>
Apr 17 10:42:30 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:42:30 user nova-compute[82522]:     </video>
Apr 17 10:42:30 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:42:30 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:42:30 user nova-compute[82522]:     </rng>
Apr 17 10:42:30 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:42:30 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:42:30 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:42:30 user nova-compute[82522]:     </memballoon>
Apr 17 10:42:30 user nova-compute[82522]:   </devices>
Apr 17 10:42:30 user nova-compute[82522]: </domain>
Apr 17 10:42:30 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1133781509',display_name='tempest-VolumesActionsTest-instance-1133781509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1133781509',id=19,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b309bb2b37284020b81369ec89397374',ramdisk_id='',reservation_id='r-0i3kb0cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-505690119',owner_user_name='tempest-VolumesActionsTest-505690119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:42:28Z,user_data=None,user_id='ae91492cb6f342f58e250622e2a3ac11',uuid=3e07a35c-b5cc-46df-8e83-21664fb83896,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converting VIF {"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:71:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc335a40-eaf8-46de-a9fe-8bcd2052b126,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc335a40-ea') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG os_vif [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:71:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc335a40-eaf8-46de-a9fe-8bcd2052b126,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc335a40-ea') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc335a40-ea, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc335a40-ea, col_values=(('external_ids', {'iface-id': 'bc335a40-eaf8-46de-a9fe-8bcd2052b126', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:71:0f', 'vm-uuid': '3e07a35c-b5cc-46df-8e83-21664fb83896'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:30 user nova-compute[82522]: INFO os_vif [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:71:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc335a40-eaf8-46de-a9fe-8bcd2052b126,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc335a40-ea')
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] No VIF found with MAC fa:16:3e:42:71:0f, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Updated VIF entry in instance network info cache for port bc335a40-eaf8-46de-a9fe-8bcd2052b126. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG nova.network.neutron [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Updating instance_info_cache with network_info: [{"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] Releasing lock "refresh_cache-3e07a35c-b5cc-46df-8e83-21664fb83896" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:42:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received event network-vif-plugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] Acquiring lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] No waiting events found dispatching network-vif-plugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:31 user nova-compute[82522]: WARNING nova.compute.manager [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received unexpected event network-vif-plugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance with vm_state building and task_state spawning.
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728138.6700883, 7792cf72-dc73-4201-9501-4515ce860735 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:33 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 7792cf72-dc73-4201-9501-4515ce860735] VM Stopped (Lifecycle Event)
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-29048006-04c3-453d-8ca1-d36d6b30f35f None None] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728153.7714694, 3e07a35c-b5cc-46df-8e83-21664fb83896 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:33 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] VM Resumed (Lifecycle Event)
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:42:33 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Instance spawned successfully.
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:33 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728153.771946, 3e07a35c-b5cc-46df-8e83-21664fb83896 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:42:33 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] VM Started (Lifecycle Event)
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:42:33 user nova-compute[82522]: INFO nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Took 5.93 seconds to spawn the instance on the hypervisor.
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received event network-vif-plugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] Acquiring lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] No waiting events found dispatching network-vif-plugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:33 user nova-compute[82522]: WARNING nova.compute.manager [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received unexpected event network-vif-plugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance with vm_state building and task_state spawning.
Apr 17 10:42:33 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:42:33 user nova-compute[82522]: INFO nova.compute.manager [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Took 6.69 seconds to build instance.
Apr 17 10:42:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.776s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:47 user nova-compute[82522]: INFO nova.compute.manager [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Terminating instance
Apr 17 10:42:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:42:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Instance destroyed successfully.
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.objects.instance [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lazy-loading 'resources' on Instance uuid b0a9753b-207e-4c23-9fea-f7dc89a5edf7 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-452716688',display_name='tempest-ServersNegativeTestJSON-server-452716688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-452716688',id=16,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8b831c3b6c244dda1821583a6b8cd08',ramdisk_id='',reservation_id='r-00pg4w34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-812869679',owner_user_name='tempest-ServersNegativeTestJSON-812869679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:41:05Z,user_data=None,user_id='1e61a5e172c34636b183ef9c84b714d8',uuid=b0a9753b-207e-4c23-9fea-f7dc89a5edf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converting VIF {"id": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "address": "fa:16:3e:48:83:0d", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fac7ecb-de", "ovs_interfaceid": "6fac7ecb-de62-4a89-b509-210fa4bedd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:83:0d,bridge_name='br-int',has_traffic_filtering=True,id=6fac7ecb-de62-4a89-b509-210fa4bedd43,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fac7ecb-de') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG os_vif [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:83:0d,bridge_name='br-int',has_traffic_filtering=True,id=6fac7ecb-de62-4a89-b509-210fa4bedd43,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fac7ecb-de') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fac7ecb-de, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: INFO os_vif [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:83:0d,bridge_name='br-int',has_traffic_filtering=True,id=6fac7ecb-de62-4a89-b509-210fa4bedd43,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fac7ecb-de')
Apr 17 10:42:48 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Deleting instance files /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7_del
Apr 17 10:42:48 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Deletion of /opt/stack/data/nova/instances/b0a9753b-207e-4c23-9fea-f7dc89a5edf7_del complete
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: INFO nova.compute.manager [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 17 10:42:48 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received event network-vif-unplugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] Acquiring lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] No waiting events found dispatching network-vif-unplugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received event network-vif-unplugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:48 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Took 0.64 seconds to deallocate network for instance.
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received event network-vif-deleted-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:48 user nova-compute[82522]: INFO nova.compute.manager [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Neutron deleted interface 6fac7ecb-de62-4a89-b509-210fa4bedd43; detaching it from the instance and deleting it from the info cache
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.network.neutron [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Detach interface failed, port_id=6fac7ecb-de62-4a89-b509-210fa4bedd43, reason: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:49 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:42:49 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:42:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:49 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Deleted allocations for instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7
Apr 17 10:42:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.898s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:50 user nova-compute[82522]: DEBUG nova.compute.manager [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received event network-vif-plugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:42:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] Acquiring lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:42:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:42:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] Lock "b0a9753b-207e-4c23-9fea-f7dc89a5edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:42:50 user nova-compute[82522]: DEBUG nova.compute.manager [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] No waiting events found dispatching network-vif-plugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:42:50 user nova-compute[82522]: WARNING nova.compute.manager [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Received unexpected event network-vif-plugged-6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance with vm_state deleted and task_state None.
Apr 17 10:42:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:42:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:03 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728168.036033, b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:43:03 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] VM Stopped (Lifecycle Event)
Apr 17 10:43:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-74c85bca-990d-43fb-a92b-d94bfa760092 None None] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:43:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:43:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:43:18 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:43:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:19 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:43:19 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:43:21 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:43:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:43:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:43:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:43:21 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:43:21 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating instance_info_cache with network_info: [{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:43:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:43:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:43:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:22 user nova-compute[82522]: INFO nova.compute.manager [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Terminating instance
Apr 17 10:43:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:43:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received event network-vif-unplugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] Acquiring lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] No waiting events found dispatching network-vif-unplugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received event network-vif-unplugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:23 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Instance destroyed successfully.
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.objects.instance [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'resources' on Instance uuid 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1128777175',display_name='tempest-VolumesAdminNegativeTest-server-1128777175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1128777175',id=17,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:41:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33eedb851ee244768016f5bf203d2f9f',ramdisk_id='',reservation_id='r-w8q3cs1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1835927457',owner_user_name='tempest-VolumesAdminNegativeTest-1835927457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:41:33Z,user_data=None,user_id='f69d4d16a4bc479ba2a8a80f359135f7',uuid=57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converting VIF {"id": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "address": "fa:16:3e:5c:79:e5", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbce56f65-9c", "ovs_interfaceid": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:79:e5,bridge_name='br-int',has_traffic_filtering=True,id=bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce56f65-9c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG os_vif [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:79:e5,bridge_name='br-int',has_traffic_filtering=True,id=bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce56f65-9c') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbce56f65-9c, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:43:23 user nova-compute[82522]: INFO os_vif [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:79:e5,bridge_name='br-int',has_traffic_filtering=True,id=bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbce56f65-9c')
Apr 17 10:43:23 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Deleting instance files /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4_del
Apr 17 10:43:23 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Deletion of /opt/stack/data/nova/instances/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4_del complete
Apr 17 10:43:23 user nova-compute[82522]: INFO nova.compute.manager [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received event network-vif-deleted-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:43:24 user nova-compute[82522]: INFO nova.compute.manager [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Neutron deleted interface bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f; detaching it from the instance and deleting it from the info cache
Apr 17 10:43:24 user nova-compute[82522]: DEBUG nova.network.neutron [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:43:24 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Took 0.63 seconds to deallocate network for instance.
Apr 17 10:43:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Detach interface failed, port_id=bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f, reason: Instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:24 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid '57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid '57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4' (instance-00000011)
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:24 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Deleted allocations for instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.157s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received event network-vif-plugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] Acquiring lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] Lock "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] No waiting events found dispatching network-vif-plugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:43:25 user nova-compute[82522]: WARNING nova.compute.manager [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Received unexpected event network-vif-plugged-bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance with vm_state deleted and task_state None.
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:43:26 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:43:26 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8115MB free_disk=26.486412048339844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 59fd26de-d46e-4f41-91f6-090005a07d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 288bc9dc-1698-4ca9-a670-5e219c04202b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e07a35c-b5cc-46df-8e83-21664fb83896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:43:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:29 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:43:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:43:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:38 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728203.604367, 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:43:38 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] VM Stopped (Lifecycle Event)
Apr 17 10:43:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e8fd3776-f49a-49c9-9fbc-a0682819e0f6 None None] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:43:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:43:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:43:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:43:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:43:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:43:52 user nova-compute[82522]: INFO nova.compute.claims [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Claim successful on node user
Apr 17 10:43:52 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:43:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:43:52 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:43:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG nova.policy [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:43:53 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Creating image(s)
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "/opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "/opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "/opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk 1073741824" returned: 0 in 0.055s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Successfully created port: 141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Cannot resize image /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'migration_context' on Instance uuid 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Ensure instance console log exists: /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Successfully updated port: 141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "refresh_cache-098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquired lock "refresh_cache-098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received event network-changed-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Refreshing instance network info cache due to event network-changed-141b2515-71aa-446f-9310-724be1ed6626. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] Acquiring lock "refresh_cache-098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Updating instance_info_cache with network_info: [{"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Releasing lock "refresh_cache-098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Instance network_info: |[{"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] Acquired lock "refresh_cache-098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Refreshing network info cache for port 141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Start _get_guest_xml network_info=[{"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:43:54 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:43:54 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141369614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-141369614',id=20,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-xwt1w01s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:43:53Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c2:c6,bridge_name='br-int',has_traffic_filtering=True,id=141b2515-71aa-446f-9310-724be1ed6626,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap141b2515-71') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'pci_devices' on Instance uuid 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:43:54 user nova-compute[82522]:   <uuid>098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f</uuid>
Apr 17 10:43:54 user nova-compute[82522]:   <name>instance-00000014</name>
Apr 17 10:43:54 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:43:54 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:43:54 user nova-compute[82522]:   <metadata>
Apr 17 10:43:54 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:43:54 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:43:54 user nova-compute[82522]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-141369614</nova:name>
Apr 17 10:43:54 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:43:54</nova:creationTime>
Apr 17 10:43:54 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:43:54 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:43:54 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:43:54 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:43:54 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:43:54 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:43:54 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:43:54 user nova-compute[82522]:       <nova:owner>
Apr 17 10:43:54 user nova-compute[82522]:         <nova:user uuid="d8cb73d24d324903a625e4782270120e">tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member</nova:user>
Apr 17 10:43:54 user nova-compute[82522]:         <nova:project uuid="faab4afa0ddf45578232627c2fac2ff8">tempest-ServerBootFromVolumeStableRescueTest-933538997</nova:project>
Apr 17 10:43:54 user nova-compute[82522]:       </nova:owner>
Apr 17 10:43:54 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:43:54 user nova-compute[82522]:       <nova:ports>
Apr 17 10:43:54 user nova-compute[82522]:         <nova:port uuid="141b2515-71aa-446f-9310-724be1ed6626">
Apr 17 10:43:54 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 10:43:54 user nova-compute[82522]:         </nova:port>
Apr 17 10:43:54 user nova-compute[82522]:       </nova:ports>
Apr 17 10:43:54 user nova-compute[82522]:     </nova:instance>
Apr 17 10:43:54 user nova-compute[82522]:   </metadata>
Apr 17 10:43:54 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:43:54 user nova-compute[82522]:     <system>
Apr 17 10:43:54 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:43:54 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:43:54 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:43:54 user nova-compute[82522]:       <entry name="serial">098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f</entry>
Apr 17 10:43:54 user nova-compute[82522]:       <entry name="uuid">098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f</entry>
Apr 17 10:43:54 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:43:54 user nova-compute[82522]:     </system>
Apr 17 10:43:54 user nova-compute[82522]:   </sysinfo>
Apr 17 10:43:54 user nova-compute[82522]:   <os>
Apr 17 10:43:54 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:43:54 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:43:54 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:43:54 user nova-compute[82522]:   </os>
Apr 17 10:43:54 user nova-compute[82522]:   <features>
Apr 17 10:43:54 user nova-compute[82522]:     <acpi/>
Apr 17 10:43:54 user nova-compute[82522]:     <apic/>
Apr 17 10:43:54 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:43:54 user nova-compute[82522]:   </features>
Apr 17 10:43:54 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:43:54 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:43:54 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:43:54 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:43:54 user nova-compute[82522]:   </clock>
Apr 17 10:43:54 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:43:54 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:43:54 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:43:54 user nova-compute[82522]:   </cpu>
Apr 17 10:43:54 user nova-compute[82522]:   <devices>
Apr 17 10:43:54 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:43:54 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:43:54 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk"/>
Apr 17 10:43:54 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:43:54 user nova-compute[82522]:     </disk>
Apr 17 10:43:54 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:43:54 user nova-compute[82522]:       <mac address="fa:16:3e:fb:c2:c6"/>
Apr 17 10:43:54 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:43:54 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:43:54 user nova-compute[82522]:       <target dev="tap141b2515-71"/>
Apr 17 10:43:54 user nova-compute[82522]:     </interface>
Apr 17 10:43:54 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:43:54 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/console.log" append="off"/>
Apr 17 10:43:54 user nova-compute[82522]:     </serial>
Apr 17 10:43:54 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:43:54 user nova-compute[82522]:     <video>
Apr 17 10:43:54 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:43:54 user nova-compute[82522]:     </video>
Apr 17 10:43:54 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:43:54 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:43:54 user nova-compute[82522]:     </rng>
Apr 17 10:43:54 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:43:54 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:43:54 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:43:54 user nova-compute[82522]:     </memballoon>
Apr 17 10:43:54 user nova-compute[82522]:   </devices>
Apr 17 10:43:54 user nova-compute[82522]: </domain>
Apr 17 10:43:54 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141369614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-141369614',id=20,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-xwt1w01s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:43:53Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c2:c6,bridge_name='br-int',has_traffic_filtering=True,id=141b2515-71aa-446f-9310-724be1ed6626,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap141b2515-71') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG os_vif [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c2:c6,bridge_name='br-int',has_traffic_filtering=True,id=141b2515-71aa-446f-9310-724be1ed6626,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap141b2515-71') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap141b2515-71, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap141b2515-71, col_values=(('external_ids', {'iface-id': '141b2515-71aa-446f-9310-724be1ed6626', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:c2:c6', 'vm-uuid': '098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:54 user nova-compute[82522]: INFO os_vif [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c2:c6,bridge_name='br-int',has_traffic_filtering=True,id=141b2515-71aa-446f-9310-724be1ed6626,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap141b2515-71')
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:43:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No VIF found with MAC fa:16:3e:fb:c2:c6, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:43:55 user nova-compute[82522]: DEBUG nova.network.neutron [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Updated VIF entry in instance network info cache for port 141b2515-71aa-446f-9310-724be1ed6626. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:43:55 user nova-compute[82522]: DEBUG nova.network.neutron [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Updating instance_info_cache with network_info: [{"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:43:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] Releasing lock "refresh_cache-098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:43:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-changed-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:43:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Refreshing instance network info cache due to event network-changed-8541d98c-fcb7-4f1a-904c-97db8145dd29. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:43:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] Acquiring lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:43:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] Acquired lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:43:55 user nova-compute[82522]: DEBUG nova.network.neutron [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Refreshing network info cache for port 8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received event network-vif-plugged-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] Acquiring lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] No waiting events found dispatching network-vif-plugged-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:43:56 user nova-compute[82522]: WARNING nova.compute.manager [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received unexpected event network-vif-plugged-141b2515-71aa-446f-9310-724be1ed6626 for instance with vm_state building and task_state spawning.
Apr 17 10:43:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updated VIF entry in instance network info cache for port 8541d98c-fcb7-4f1a-904c-97db8145dd29. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updating instance_info_cache with network_info: [{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] Releasing lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:43:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728238.5032978, 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:43:58 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] VM Resumed (Lifecycle Event)
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:43:58 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Instance spawned successfully.
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:43:58 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728238.5054886, 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:43:58 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] VM Started (Lifecycle Event)
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received event network-vif-plugged-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] Acquiring lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] No waiting events found dispatching network-vif-plugged-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:43:58 user nova-compute[82522]: WARNING nova.compute.manager [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received unexpected event network-vif-plugged-141b2515-71aa-446f-9310-724be1ed6626 for instance with vm_state building and task_state spawning.
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:43:58 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:43:58 user nova-compute[82522]: INFO nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Took 5.58 seconds to spawn the instance on the hypervisor.
Apr 17 10:43:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:43:58 user nova-compute[82522]: INFO nova.compute.manager [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Took 6.26 seconds to build instance.
Apr 17 10:43:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.358s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:59 user nova-compute[82522]: INFO nova.compute.manager [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Shelving
Apr 17 10:43:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG nova.compute.manager [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-unplugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:43:59 user nova-compute[82522]: DEBUG nova.compute.manager [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] No waiting events found dispatching network-vif-unplugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:43:59 user nova-compute[82522]: WARNING nova.compute.manager [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received unexpected event network-vif-unplugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance with vm_state active and task_state shelving.
Apr 17 10:44:00 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance destroyed successfully.
Apr 17 10:44:00 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Beginning cold snapshot process
Apr 17 10:44:00 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:44:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk /opt/stack/data/nova/instances/snapshots/tmp_q0ofdnq/3963128a22204a349ee2d6614015a092 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk /opt/stack/data/nova/instances/snapshots/tmp_q0ofdnq/3963128a22204a349ee2d6614015a092" returned: 0 in 0.471s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Snapshot extracted, beginning image upload
Apr 17 10:44:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] No waiting events found dispatching network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:44:02 user nova-compute[82522]: WARNING nova.compute.manager [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received unexpected event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance with vm_state active and task_state shelving_image_uploading.
Apr 17 10:44:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Snapshot image upload complete
Apr 17 10:44:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:44:03 user nova-compute[82522]: INFO nova.compute.manager [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Shelve offloading
Apr 17 10:44:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance destroyed successfully.
Apr 17 10:44:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:44:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:44:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquired lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:44:03 user nova-compute[82522]: DEBUG nova.network.neutron [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:44:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG nova.network.neutron [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updating instance_info_cache with network_info: [{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Releasing lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance destroyed successfully.
Apr 17 10:44:04 user nova-compute[82522]: DEBUG nova.objects.instance [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'resources' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486235308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486235308',id=18,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDukjSLeCue+jobK7F8+eqUod8S/SPwFRRjU948hgPTGwDtheEfK10Qt0k7bGB9RgcPDrWEuC4lYGOl33GS6HRjNgrGZR1aDCH1PVL2Qkt1O7P4VtYS1j0HHPoUkaMdtKQ==',key_name='tempest-keypair-1963349943',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:42:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-nhvcv880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member',shelved_at='2023-04-17T10:44:03.592343',shelved_host='user',shelved_image_id='f64e76d4-2b30-4d49-984a-133a7b24e9da'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:44:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=288bc9dc-1698-4ca9-a670-5e219c04202b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG os_vif [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-changed-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Refreshing instance network info cache due to event network-changed-8541d98c-fcb7-4f1a-904c-97db8145dd29. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] Acquiring lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] Acquired lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Refreshing network info cache for port 8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8541d98c-fc, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:44:04 user nova-compute[82522]: INFO os_vif [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc')
Apr 17 10:44:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Deleting instance files /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b_del
Apr 17 10:44:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Deletion of /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b_del complete
Apr 17 10:44:04 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Deleted allocations for instance 288bc9dc-1698-4ca9-a670-5e219c04202b
Apr 17 10:44:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:05 user nova-compute[82522]: DEBUG nova.objects.instance [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'numa_topology' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:44:05 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:44:05 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:44:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:05 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updated VIF entry in instance network info cache for port 8541d98c-fcb7-4f1a-904c-97db8145dd29. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:44:05 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updating instance_info_cache with network_info: [{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8541d98c-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:44:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] Releasing lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:44:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.773s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:08 user nova-compute[82522]: INFO nova.compute.manager [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Terminating instance
Apr 17 10:44:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-unplugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-unplugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-unplugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:44:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Instance destroyed successfully.
Apr 17 10:44:09 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'resources' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-92438997',display_name='tempest-AttachVolumeTestJSON-server-92438997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-92438997',id=3,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw==',key_name='tempest-keypair-1429660859',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-ip2vpwam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=59fd26de-d46e-4f41-91f6-090005a07d99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "7124043d-665c-4a42-a041-b91ccc237b63", "address": "fa:16:3e:7f:75:70", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7124043d-66", "ovs_interfaceid": "7124043d-665c-4a42-a041-b91ccc237b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG os_vif [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7124043d-66, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:44:09 user nova-compute[82522]: INFO os_vif [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:75:70,bridge_name='br-int',has_traffic_filtering=True,id=7124043d-665c-4a42-a041-b91ccc237b63,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7124043d-66')
Apr 17 10:44:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Deleting instance files /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99_del
Apr 17 10:44:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Deletion of /opt/stack/data/nova/instances/59fd26de-d46e-4f41-91f6-090005a07d99_del complete
Apr 17 10:44:09 user nova-compute[82522]: INFO nova.compute.manager [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 17 10:44:09 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:44:09 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:44:10 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:44:10 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Took 0.81 seconds to deallocate network for instance.
Apr 17 10:44:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:10 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:44:10 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:44:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:10 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Deleted allocations for instance 59fd26de-d46e-4f41-91f6-090005a07d99
Apr 17 10:44:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "59fd26de-d46e-4f41-91f6-090005a07d99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.151s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] Acquiring lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] Lock "59fd26de-d46e-4f41-91f6-090005a07d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] No waiting events found dispatching network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:44:11 user nova-compute[82522]: WARNING nova.compute.manager [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received unexpected event network-vif-plugged-7124043d-665c-4a42-a041-b91ccc237b63 for instance with vm_state deleted and task_state None.
Apr 17 10:44:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Received event network-vif-deleted-7124043d-665c-4a42-a041-b91ccc237b63 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:15 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728240.471734, 288bc9dc-1698-4ca9-a670-5e219c04202b => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:44:15 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] VM Stopped (Lifecycle Event)
Apr 17 10:44:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ad10e5c-1e76-42cc-883b-f500252eb8fd None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:16 user nova-compute[82522]: INFO nova.compute.manager [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Terminating instance
Apr 17 10:44:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received event network-vif-unplugged-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] No waiting events found dispatching network-vif-unplugged-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received event network-vif-unplugged-e66863ce-1b10-4701-9a7c-3940117a0237 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:44:17 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Instance destroyed successfully.
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.objects.instance [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'resources' on Instance uuid 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1787327953',display_name='tempest-VolumesAdminNegativeTest-server-1787327953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1787327953',id=14,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnn0G8T/NqKd4pdI8CnZBIrfuGV0OGYhlLKbelX5jBuYIOxA1KkpZDA2TZvP5aUxJYkJ3etLyosOZOXzhagUGOxEpiTev/9WWYjYrPv7DYs6AD3kMjO6NHdWKptKjHhkQ==',key_name='tempest-keypair-1894950384',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33eedb851ee244768016f5bf203d2f9f',ramdisk_id='',reservation_id='r-alaieves',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1835927457',owner_user_name='tempest-VolumesAdminNegativeTest-1835927457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f69d4d16a4bc479ba2a8a80f359135f7',uuid=89bbf0b5-0314-4bc5-ba97-feae5a5a49bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converting VIF {"id": "e66863ce-1b10-4701-9a7c-3940117a0237", "address": "fa:16:3e:ba:1a:44", "network": {"id": "0635a321-37ea-416c-9e45-a059e4a4a9bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1644479839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33eedb851ee244768016f5bf203d2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66863ce-1b", "ovs_interfaceid": "e66863ce-1b10-4701-9a7c-3940117a0237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1a:44,bridge_name='br-int',has_traffic_filtering=True,id=e66863ce-1b10-4701-9a7c-3940117a0237,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66863ce-1b') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG os_vif [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1a:44,bridge_name='br-int',has_traffic_filtering=True,id=e66863ce-1b10-4701-9a7c-3940117a0237,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66863ce-1b') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape66863ce-1b, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:44:17 user nova-compute[82522]: INFO os_vif [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1a:44,bridge_name='br-int',has_traffic_filtering=True,id=e66863ce-1b10-4701-9a7c-3940117a0237,network=Network(0635a321-37ea-416c-9e45-a059e4a4a9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66863ce-1b')
Apr 17 10:44:17 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Deleting instance files /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf_del
Apr 17 10:44:17 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Deletion of /opt/stack/data/nova/instances/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf_del complete
Apr 17 10:44:17 user nova-compute[82522]: INFO nova.compute.manager [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 17 10:44:17 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "3e07a35c-b5cc-46df-8e83-21664fb83896" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:17 user nova-compute[82522]: INFO nova.compute.manager [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Terminating instance
Apr 17 10:44:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:44:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Instance destroyed successfully.
Apr 17 10:44:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lazy-loading 'resources' on Instance uuid 3e07a35c-b5cc-46df-8e83-21664fb83896 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1133781509',display_name='tempest-VolumesActionsTest-instance-1133781509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1133781509',id=19,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b309bb2b37284020b81369ec89397374',ramdisk_id='',reservation_id='r-0i3kb0cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-505690119',owner_user_name='tempest-VolumesActionsTest-505690119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:42:34Z,user_data=None,user_id='ae91492cb6f342f58e250622e2a3ac11',uuid=3e07a35c-b5cc-46df-8e83-21664fb83896,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converting VIF {"id": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "address": "fa:16:3e:42:71:0f", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc335a40-ea", "ovs_interfaceid": "bc335a40-eaf8-46de-a9fe-8bcd2052b126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:71:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc335a40-eaf8-46de-a9fe-8bcd2052b126,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc335a40-ea') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG os_vif [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:71:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc335a40-eaf8-46de-a9fe-8bcd2052b126,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc335a40-ea') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc335a40-ea, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:44:18 user nova-compute[82522]: INFO os_vif [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:71:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc335a40-eaf8-46de-a9fe-8bcd2052b126,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc335a40-ea')
Apr 17 10:44:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Deleting instance files /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896_del
Apr 17 10:44:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Deletion of /opt/stack/data/nova/instances/3e07a35c-b5cc-46df-8e83-21664fb83896_del complete
Apr 17 10:44:18 user nova-compute[82522]: INFO nova.compute.manager [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 17 10:44:18 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received event network-vif-unplugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] Acquiring lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] No waiting events found dispatching network-vif-unplugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received event network-vif-unplugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:44:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG nova.compute.manager [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received event network-vif-plugged-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] Acquiring lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG nova.compute.manager [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] No waiting events found dispatching network-vif-plugged-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:44:19 user nova-compute[82522]: WARNING nova.compute.manager [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received unexpected event network-vif-plugged-e66863ce-1b10-4701-9a7c-3940117a0237 for instance with vm_state active and task_state deleting.
Apr 17 10:44:19 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:44:19 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Took 1.84 seconds to deallocate network for instance.
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:44:19 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Took 1.08 seconds to deallocate network for instance.
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.076s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:19 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Deleted allocations for instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.127s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:44:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:20 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Deleted allocations for instance 3e07a35c-b5cc-46df-8e83-21664fb83896
Apr 17 10:44:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.226s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received event network-vif-plugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Acquiring lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Lock "3e07a35c-b5cc-46df-8e83-21664fb83896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] No waiting events found dispatching network-vif-plugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:44:20 user nova-compute[82522]: WARNING nova.compute.manager [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received unexpected event network-vif-plugged-bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance with vm_state deleted and task_state None.
Apr 17 10:44:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Received event network-vif-deleted-e66863ce-1b10-4701-9a7c-3940117a0237 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Received event network-vif-deleted-bc335a40-eaf8-46de-a9fe-8bcd2052b126 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:21 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-5e03807e-942b-4155-835b-b1c86f5b80f5" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-5e03807e-942b-4155-835b-b1c86f5b80f5" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Updating instance_info_cache with network_info: [{"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-5e03807e-942b-4155-835b-b1c86f5b80f5" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:44:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:24 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:24 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:44:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:24 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728249.4095974, 59fd26de-d46e-4f41-91f6-090005a07d99 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:44:24 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] VM Stopped (Lifecycle Event)
Apr 17 10:44:24 user nova-compute[82522]: DEBUG nova.compute.manager [None req-789616f9-00fd-4438-9120-bf059c2e9278 None None] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:44:26 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:44:26 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=26.50754165649414GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:44:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:44:29 user nova-compute[82522]: INFO nova.compute.claims [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Claim successful on node user
Apr 17 10:44:29 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:44:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:44:29 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:44:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:44:30 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Creating image(s)
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "/opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "/opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "/opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG nova.policy [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk 1073741824" returned: 0 in 0.091s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Cannot resize image /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG nova.objects.instance [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'migration_context' on Instance uuid d61e9333-fe01-4a9e-abab-ef31ba6d4173 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Ensure instance console log exists: /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:30 user nova-compute[82522]: DEBUG nova.network.neutron [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Successfully created port: 481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Successfully updated port: 481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquired lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received event network-changed-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Refreshing instance network info cache due to event network-changed-481e24d2-75a9-47c3-8d22-8573d260e7d3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] Acquiring lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updating instance_info_cache with network_info: [{"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Releasing lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Instance network_info: |[{"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] Acquired lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.network.neutron [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Refreshing network info cache for port 481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Start _get_guest_xml network_info=[{"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:44:31 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:44:31 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1766110854',display_name='tempest-TestStampPattern-server-1766110854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1766110854',id=21,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuLQDJ2Z2AMQjPcpwBXxC60PoD0xwIae5XZ5z7x5L/fK+zl+/qEVvPMCnw86sAZZJR+5qNlBLSq4czZc4jysEkTXetR347vw/3aJ1wazOlhSEz/iMS3Zyr7Za5/g937hg==',key_name='tempest-TestStampPattern-12722321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84cd384dfcbb4739b9694704c1fad001',ramdisk_id='',reservation_id='r-fjj65jgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2056640667',owner_user_name='tempest-TestStampPattern-2056640667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:44:30Z,user_data=None,user_id='708740584a3d488da0ee13e5f8299b7f',uuid=d61e9333-fe01-4a9e-abab-ef31ba6d4173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converting VIF {"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:60:7d,bridge_name='br-int',has_traffic_filtering=True,id=481e24d2-75a9-47c3-8d22-8573d260e7d3,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481e24d2-75') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.objects.instance [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'pci_devices' on Instance uuid d61e9333-fe01-4a9e-abab-ef31ba6d4173 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:44:31 user nova-compute[82522]:   <uuid>d61e9333-fe01-4a9e-abab-ef31ba6d4173</uuid>
Apr 17 10:44:31 user nova-compute[82522]:   <name>instance-00000015</name>
Apr 17 10:44:31 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:44:31 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:44:31 user nova-compute[82522]:   <metadata>
Apr 17 10:44:31 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:44:31 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:44:31 user nova-compute[82522]:       <nova:name>tempest-TestStampPattern-server-1766110854</nova:name>
Apr 17 10:44:31 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:44:31</nova:creationTime>
Apr 17 10:44:31 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:44:31 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:44:31 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:44:31 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:44:31 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:44:31 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:44:31 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:44:31 user nova-compute[82522]:       <nova:owner>
Apr 17 10:44:31 user nova-compute[82522]:         <nova:user uuid="708740584a3d488da0ee13e5f8299b7f">tempest-TestStampPattern-2056640667-project-member</nova:user>
Apr 17 10:44:31 user nova-compute[82522]:         <nova:project uuid="84cd384dfcbb4739b9694704c1fad001">tempest-TestStampPattern-2056640667</nova:project>
Apr 17 10:44:31 user nova-compute[82522]:       </nova:owner>
Apr 17 10:44:31 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:44:31 user nova-compute[82522]:       <nova:ports>
Apr 17 10:44:31 user nova-compute[82522]:         <nova:port uuid="481e24d2-75a9-47c3-8d22-8573d260e7d3">
Apr 17 10:44:31 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 17 10:44:31 user nova-compute[82522]:         </nova:port>
Apr 17 10:44:31 user nova-compute[82522]:       </nova:ports>
Apr 17 10:44:31 user nova-compute[82522]:     </nova:instance>
Apr 17 10:44:31 user nova-compute[82522]:   </metadata>
Apr 17 10:44:31 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:44:31 user nova-compute[82522]:     <system>
Apr 17 10:44:31 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:44:31 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:44:31 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:44:31 user nova-compute[82522]:       <entry name="serial">d61e9333-fe01-4a9e-abab-ef31ba6d4173</entry>
Apr 17 10:44:31 user nova-compute[82522]:       <entry name="uuid">d61e9333-fe01-4a9e-abab-ef31ba6d4173</entry>
Apr 17 10:44:31 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:44:31 user nova-compute[82522]:     </system>
Apr 17 10:44:31 user nova-compute[82522]:   </sysinfo>
Apr 17 10:44:31 user nova-compute[82522]:   <os>
Apr 17 10:44:31 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:44:31 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:44:31 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:44:31 user nova-compute[82522]:   </os>
Apr 17 10:44:31 user nova-compute[82522]:   <features>
Apr 17 10:44:31 user nova-compute[82522]:     <acpi/>
Apr 17 10:44:31 user nova-compute[82522]:     <apic/>
Apr 17 10:44:31 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:44:31 user nova-compute[82522]:   </features>
Apr 17 10:44:31 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:44:31 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:44:31 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:44:31 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:44:31 user nova-compute[82522]:   </clock>
Apr 17 10:44:31 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:44:31 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:44:31 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:44:31 user nova-compute[82522]:   </cpu>
Apr 17 10:44:31 user nova-compute[82522]:   <devices>
Apr 17 10:44:31 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:44:31 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:44:31 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk"/>
Apr 17 10:44:31 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:44:31 user nova-compute[82522]:     </disk>
Apr 17 10:44:31 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:44:31 user nova-compute[82522]:       <mac address="fa:16:3e:5d:60:7d"/>
Apr 17 10:44:31 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:44:31 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:44:31 user nova-compute[82522]:       <target dev="tap481e24d2-75"/>
Apr 17 10:44:31 user nova-compute[82522]:     </interface>
Apr 17 10:44:31 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:44:31 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/console.log" append="off"/>
Apr 17 10:44:31 user nova-compute[82522]:     </serial>
Apr 17 10:44:31 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:44:31 user nova-compute[82522]:     <video>
Apr 17 10:44:31 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:44:31 user nova-compute[82522]:     </video>
Apr 17 10:44:31 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:44:31 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:44:31 user nova-compute[82522]:     </rng>
Apr 17 10:44:31 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:44:31 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:44:31 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:44:31 user nova-compute[82522]:     </memballoon>
Apr 17 10:44:31 user nova-compute[82522]:   </devices>
Apr 17 10:44:31 user nova-compute[82522]: </domain>
Apr 17 10:44:31 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1766110854',display_name='tempest-TestStampPattern-server-1766110854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1766110854',id=21,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuLQDJ2Z2AMQjPcpwBXxC60PoD0xwIae5XZ5z7x5L/fK+zl+/qEVvPMCnw86sAZZJR+5qNlBLSq4czZc4jysEkTXetR347vw/3aJ1wazOlhSEz/iMS3Zyr7Za5/g937hg==',key_name='tempest-TestStampPattern-12722321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84cd384dfcbb4739b9694704c1fad001',ramdisk_id='',reservation_id='r-fjj65jgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2056640667',owner_user_name='tempest-TestStampPattern-2056640667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:44:30Z,user_data=None,user_id='708740584a3d488da0ee13e5f8299b7f',uuid=d61e9333-fe01-4a9e-abab-ef31ba6d4173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converting VIF {"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:60:7d,bridge_name='br-int',has_traffic_filtering=True,id=481e24d2-75a9-47c3-8d22-8573d260e7d3,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481e24d2-75') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG os_vif [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:60:7d,bridge_name='br-int',has_traffic_filtering=True,id=481e24d2-75a9-47c3-8d22-8573d260e7d3,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481e24d2-75') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap481e24d2-75, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap481e24d2-75, col_values=(('external_ids', {'iface-id': '481e24d2-75a9-47c3-8d22-8573d260e7d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:60:7d', 'vm-uuid': 'd61e9333-fe01-4a9e-abab-ef31ba6d4173'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:31 user nova-compute[82522]: INFO os_vif [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:60:7d,bridge_name='br-int',has_traffic_filtering=True,id=481e24d2-75a9-47c3-8d22-8573d260e7d3,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481e24d2-75')
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:44:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No VIF found with MAC fa:16:3e:5d:60:7d, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:44:32 user nova-compute[82522]: DEBUG nova.network.neutron [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updated VIF entry in instance network info cache for port 481e24d2-75a9-47c3-8d22-8573d260e7d3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:44:32 user nova-compute[82522]: DEBUG nova.network.neutron [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updating instance_info_cache with network_info: [{"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:44:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] Releasing lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:44:32 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728257.5254314, 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:44:32 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] VM Stopped (Lifecycle Event)
Apr 17 10:44:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-648eb01a-05ce-4ada-a7c4-590f44aa737a None None] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received event network-vif-plugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] No waiting events found dispatching network-vif-plugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:44:33 user nova-compute[82522]: WARNING nova.compute.manager [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received unexpected event network-vif-plugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance with vm_state building and task_state spawning.
Apr 17 10:44:33 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728258.4368281, 3e07a35c-b5cc-46df-8e83-21664fb83896 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:44:33 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] VM Stopped (Lifecycle Event)
Apr 17 10:44:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1ce681e5-dbdc-43c9-a8e6-0397aba55378 None None] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728275.4400256, d61e9333-fe01-4a9e-abab-ef31ba6d4173 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:44:35 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] VM Resumed (Lifecycle Event)
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:44:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Instance spawned successfully.
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:44:35 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728275.4453723, d61e9333-fe01-4a9e-abab-ef31ba6d4173 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:44:35 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] VM Started (Lifecycle Event)
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received event network-vif-plugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] No waiting events found dispatching network-vif-plugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:44:35 user nova-compute[82522]: WARNING nova.compute.manager [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received unexpected event network-vif-plugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance with vm_state building and task_state spawning.
Apr 17 10:44:35 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:44:35 user nova-compute[82522]: INFO nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 17 10:44:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:44:35 user nova-compute[82522]: INFO nova.compute.manager [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Took 6.07 seconds to build instance.
Apr 17 10:44:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.165s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:44:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:44:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:45:02 user nova-compute[82522]: INFO nova.compute.claims [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Claim successful on node user
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:45:02 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:45:02 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Creating image(s)
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "/opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "/opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "/opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG nova.policy [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk 1073741824" returned: 0 in 0.051s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Cannot resize image /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'migration_context' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Ensure instance console log exists: /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Successfully created port: 20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:45:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Successfully updated port: 20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "refresh_cache-44e80daa-73f1-4b84-8cbc-3dd0ea159da3" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquired lock "refresh_cache-44e80daa-73f1-4b84-8cbc-3dd0ea159da3" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received event network-changed-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Refreshing instance network info cache due to event network-changed-20b83dbf-57d7-4d67-b030-53b0d12f01e2. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] Acquiring lock "refresh_cache-44e80daa-73f1-4b84-8cbc-3dd0ea159da3" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Updating instance_info_cache with network_info: [{"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Releasing lock "refresh_cache-44e80daa-73f1-4b84-8cbc-3dd0ea159da3" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Instance network_info: |[{"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] Acquired lock "refresh_cache-44e80daa-73f1-4b84-8cbc-3dd0ea159da3" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.network.neutron [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Refreshing network info cache for port 20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Start _get_guest_xml network_info=[{"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:45:04 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:04 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1717620221',display_name='tempest-AttachVolumeTestJSON-server-1717620221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1717620221',id=22,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2zQYbD7AeLgZmChqO+D6PkkPLUnwIfI8qHYFWa2oQb85VVSXg9rCtBd8+F+B7OSL/DhEpq2QZwWqNC6GQai65/T4R6/KjN1qcR2Nh9LeePxLKBQPRrXkccsLFsLvoclQ==',key_name='tempest-keypair-126931336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-h6ohd45e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=44e80daa-73f1-4b84-8cbc-3dd0ea159da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:51:8a,bridge_name='br-int',has_traffic_filtering=True,id=20b83dbf-57d7-4d67-b030-53b0d12f01e2,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b83dbf-57') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'pci_devices' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:45:04 user nova-compute[82522]:   <uuid>44e80daa-73f1-4b84-8cbc-3dd0ea159da3</uuid>
Apr 17 10:45:04 user nova-compute[82522]:   <name>instance-00000016</name>
Apr 17 10:45:04 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:45:04 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:45:04 user nova-compute[82522]:   <metadata>
Apr 17 10:45:04 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:45:04 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:45:04 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeTestJSON-server-1717620221</nova:name>
Apr 17 10:45:04 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:45:04</nova:creationTime>
Apr 17 10:45:04 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:45:04 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:45:04 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:45:04 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:45:04 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:45:04 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:45:04 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:45:04 user nova-compute[82522]:       <nova:owner>
Apr 17 10:45:04 user nova-compute[82522]:         <nova:user uuid="a9862432f87f4500a46f32a0b27d54d4">tempest-AttachVolumeTestJSON-2096000567-project-member</nova:user>
Apr 17 10:45:04 user nova-compute[82522]:         <nova:project uuid="6a17ec3e1b314acbb701f2d2d27d0560">tempest-AttachVolumeTestJSON-2096000567</nova:project>
Apr 17 10:45:04 user nova-compute[82522]:       </nova:owner>
Apr 17 10:45:04 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:45:04 user nova-compute[82522]:       <nova:ports>
Apr 17 10:45:04 user nova-compute[82522]:         <nova:port uuid="20b83dbf-57d7-4d67-b030-53b0d12f01e2">
Apr 17 10:45:04 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 10:45:04 user nova-compute[82522]:         </nova:port>
Apr 17 10:45:04 user nova-compute[82522]:       </nova:ports>
Apr 17 10:45:04 user nova-compute[82522]:     </nova:instance>
Apr 17 10:45:04 user nova-compute[82522]:   </metadata>
Apr 17 10:45:04 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:45:04 user nova-compute[82522]:     <system>
Apr 17 10:45:04 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:45:04 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:45:04 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:45:04 user nova-compute[82522]:       <entry name="serial">44e80daa-73f1-4b84-8cbc-3dd0ea159da3</entry>
Apr 17 10:45:04 user nova-compute[82522]:       <entry name="uuid">44e80daa-73f1-4b84-8cbc-3dd0ea159da3</entry>
Apr 17 10:45:04 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:45:04 user nova-compute[82522]:     </system>
Apr 17 10:45:04 user nova-compute[82522]:   </sysinfo>
Apr 17 10:45:04 user nova-compute[82522]:   <os>
Apr 17 10:45:04 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:45:04 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:45:04 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:45:04 user nova-compute[82522]:   </os>
Apr 17 10:45:04 user nova-compute[82522]:   <features>
Apr 17 10:45:04 user nova-compute[82522]:     <acpi/>
Apr 17 10:45:04 user nova-compute[82522]:     <apic/>
Apr 17 10:45:04 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:45:04 user nova-compute[82522]:   </features>
Apr 17 10:45:04 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:45:04 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:45:04 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:45:04 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:45:04 user nova-compute[82522]:   </clock>
Apr 17 10:45:04 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:45:04 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:45:04 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:45:04 user nova-compute[82522]:   </cpu>
Apr 17 10:45:04 user nova-compute[82522]:   <devices>
Apr 17 10:45:04 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:45:04 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:45:04 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk"/>
Apr 17 10:45:04 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:45:04 user nova-compute[82522]:     </disk>
Apr 17 10:45:04 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:45:04 user nova-compute[82522]:       <mac address="fa:16:3e:c3:51:8a"/>
Apr 17 10:45:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:45:04 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:45:04 user nova-compute[82522]:       <target dev="tap20b83dbf-57"/>
Apr 17 10:45:04 user nova-compute[82522]:     </interface>
Apr 17 10:45:04 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:45:04 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/console.log" append="off"/>
Apr 17 10:45:04 user nova-compute[82522]:     </serial>
Apr 17 10:45:04 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:45:04 user nova-compute[82522]:     <video>
Apr 17 10:45:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:45:04 user nova-compute[82522]:     </video>
Apr 17 10:45:04 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:45:04 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:45:04 user nova-compute[82522]:     </rng>
Apr 17 10:45:04 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:45:04 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:45:04 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:45:04 user nova-compute[82522]:     </memballoon>
Apr 17 10:45:04 user nova-compute[82522]:   </devices>
Apr 17 10:45:04 user nova-compute[82522]: </domain>
Apr 17 10:45:04 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1717620221',display_name='tempest-AttachVolumeTestJSON-server-1717620221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1717620221',id=22,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2zQYbD7AeLgZmChqO+D6PkkPLUnwIfI8qHYFWa2oQb85VVSXg9rCtBd8+F+B7OSL/DhEpq2QZwWqNC6GQai65/T4R6/KjN1qcR2Nh9LeePxLKBQPRrXkccsLFsLvoclQ==',key_name='tempest-keypair-126931336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-h6ohd45e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=44e80daa-73f1-4b84-8cbc-3dd0ea159da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:51:8a,bridge_name='br-int',has_traffic_filtering=True,id=20b83dbf-57d7-4d67-b030-53b0d12f01e2,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b83dbf-57') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG os_vif [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:51:8a,bridge_name='br-int',has_traffic_filtering=True,id=20b83dbf-57d7-4d67-b030-53b0d12f01e2,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b83dbf-57') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20b83dbf-57, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20b83dbf-57, col_values=(('external_ids', {'iface-id': '20b83dbf-57d7-4d67-b030-53b0d12f01e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:51:8a', 'vm-uuid': '44e80daa-73f1-4b84-8cbc-3dd0ea159da3'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:04 user nova-compute[82522]: INFO os_vif [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:51:8a,bridge_name='br-int',has_traffic_filtering=True,id=20b83dbf-57d7-4d67-b030-53b0d12f01e2,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b83dbf-57')
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:45:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No VIF found with MAC fa:16:3e:c3:51:8a, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:45:05 user nova-compute[82522]: DEBUG nova.network.neutron [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Updated VIF entry in instance network info cache for port 20b83dbf-57d7-4d67-b030-53b0d12f01e2. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:45:05 user nova-compute[82522]: DEBUG nova.network.neutron [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Updating instance_info_cache with network_info: [{"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:45:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] Releasing lock "refresh_cache-44e80daa-73f1-4b84-8cbc-3dd0ea159da3" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received event network-vif-plugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] No waiting events found dispatching network-vif-plugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:45:06 user nova-compute[82522]: WARNING nova.compute.manager [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received unexpected event network-vif-plugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance with vm_state building and task_state spawning.
Apr 17 10:45:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728308.2597036, 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:45:08 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] VM Resumed (Lifecycle Event)
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:45:08 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Instance spawned successfully.
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:08 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728308.2611415, 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:45:08 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] VM Started (Lifecycle Event)
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:45:08 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:45:08 user nova-compute[82522]: INFO nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:08 user nova-compute[82522]: INFO nova.compute.manager [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Took 6.11 seconds to build instance.
Apr 17 10:45:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.198s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received event network-vif-plugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] No waiting events found dispatching network-vif-plugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:45:08 user nova-compute[82522]: WARNING nova.compute.manager [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received unexpected event network-vif-plugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance with vm_state active and task_state None.
Apr 17 10:45:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "9174e76f-1f0e-431c-b190-cb857eead406" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "9174e76f-1f0e-431c-b190-cb857eead406" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:45:10 user nova-compute[82522]: INFO nova.compute.claims [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Claim successful on node user
Apr 17 10:45:10 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:45:10 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:45:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.policy [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae91492cb6f342f58e250622e2a3ac11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309bb2b37284020b81369ec89397374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:45:11 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Creating image(s)
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "/opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "/opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "/opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.170s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.168s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk 1073741824" returned: 0 in 0.053s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.167s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Successfully created port: d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Cannot resize image /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lazy-loading 'migration_context' on Instance uuid 9174e76f-1f0e-431c-b190-cb857eead406 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Ensure instance console log exists: /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Successfully updated port: d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "refresh_cache-9174e76f-1f0e-431c-b190-cb857eead406" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquired lock "refresh_cache-9174e76f-1f0e-431c-b190-cb857eead406" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received event network-changed-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Refreshing instance network info cache due to event network-changed-d988d5c2-1a5a-425e-8dca-eee7b1783eae. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] Acquiring lock "refresh_cache-9174e76f-1f0e-431c-b190-cb857eead406" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Updating instance_info_cache with network_info: [{"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Releasing lock "refresh_cache-9174e76f-1f0e-431c-b190-cb857eead406" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Instance network_info: |[{"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] Acquired lock "refresh_cache-9174e76f-1f0e-431c-b190-cb857eead406" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG nova.network.neutron [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Refreshing network info cache for port d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:45:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Start _get_guest_xml network_info=[{"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:45:13 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:13 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1414837798',display_name='tempest-VolumesActionsTest-instance-1414837798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1414837798',id=23,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b309bb2b37284020b81369ec89397374',ramdisk_id='',reservation_id='r-0r238meg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-505690119',owner_user_name='tempest-VolumesActionsTest-505690119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:45:11Z,user_data=None,user_id='ae91492cb6f342f58e250622e2a3ac11',uuid=9174e76f-1f0e-431c-b190-cb857eead406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converting VIF {"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:73:2b,bridge_name='br-int',has_traffic_filtering=True,id=d988d5c2-1a5a-425e-8dca-eee7b1783eae,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd988d5c2-1a') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lazy-loading 'pci_devices' on Instance uuid 9174e76f-1f0e-431c-b190-cb857eead406 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:45:13 user nova-compute[82522]:   <uuid>9174e76f-1f0e-431c-b190-cb857eead406</uuid>
Apr 17 10:45:13 user nova-compute[82522]:   <name>instance-00000017</name>
Apr 17 10:45:13 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:45:13 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:45:13 user nova-compute[82522]:   <metadata>
Apr 17 10:45:13 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:45:13 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:45:13 user nova-compute[82522]:       <nova:name>tempest-VolumesActionsTest-instance-1414837798</nova:name>
Apr 17 10:45:13 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:45:13</nova:creationTime>
Apr 17 10:45:13 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:45:13 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:45:13 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:45:13 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:45:13 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:45:13 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:45:13 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:45:13 user nova-compute[82522]:       <nova:owner>
Apr 17 10:45:13 user nova-compute[82522]:         <nova:user uuid="ae91492cb6f342f58e250622e2a3ac11">tempest-VolumesActionsTest-505690119-project-member</nova:user>
Apr 17 10:45:13 user nova-compute[82522]:         <nova:project uuid="b309bb2b37284020b81369ec89397374">tempest-VolumesActionsTest-505690119</nova:project>
Apr 17 10:45:13 user nova-compute[82522]:       </nova:owner>
Apr 17 10:45:13 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:45:13 user nova-compute[82522]:       <nova:ports>
Apr 17 10:45:13 user nova-compute[82522]:         <nova:port uuid="d988d5c2-1a5a-425e-8dca-eee7b1783eae">
Apr 17 10:45:13 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 17 10:45:13 user nova-compute[82522]:         </nova:port>
Apr 17 10:45:13 user nova-compute[82522]:       </nova:ports>
Apr 17 10:45:13 user nova-compute[82522]:     </nova:instance>
Apr 17 10:45:13 user nova-compute[82522]:   </metadata>
Apr 17 10:45:13 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:45:13 user nova-compute[82522]:     <system>
Apr 17 10:45:13 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:45:13 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:45:13 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:45:13 user nova-compute[82522]:       <entry name="serial">9174e76f-1f0e-431c-b190-cb857eead406</entry>
Apr 17 10:45:13 user nova-compute[82522]:       <entry name="uuid">9174e76f-1f0e-431c-b190-cb857eead406</entry>
Apr 17 10:45:13 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:45:13 user nova-compute[82522]:     </system>
Apr 17 10:45:13 user nova-compute[82522]:   </sysinfo>
Apr 17 10:45:13 user nova-compute[82522]:   <os>
Apr 17 10:45:13 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:45:13 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:45:13 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:45:13 user nova-compute[82522]:   </os>
Apr 17 10:45:13 user nova-compute[82522]:   <features>
Apr 17 10:45:13 user nova-compute[82522]:     <acpi/>
Apr 17 10:45:13 user nova-compute[82522]:     <apic/>
Apr 17 10:45:13 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:45:13 user nova-compute[82522]:   </features>
Apr 17 10:45:13 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:45:13 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:45:13 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:45:13 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:45:13 user nova-compute[82522]:   </clock>
Apr 17 10:45:13 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:45:13 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:45:13 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:45:13 user nova-compute[82522]:   </cpu>
Apr 17 10:45:13 user nova-compute[82522]:   <devices>
Apr 17 10:45:13 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:45:13 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:45:13 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk"/>
Apr 17 10:45:13 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:45:13 user nova-compute[82522]:     </disk>
Apr 17 10:45:13 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:45:13 user nova-compute[82522]:       <mac address="fa:16:3e:d3:73:2b"/>
Apr 17 10:45:13 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:45:13 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:45:13 user nova-compute[82522]:       <target dev="tapd988d5c2-1a"/>
Apr 17 10:45:13 user nova-compute[82522]:     </interface>
Apr 17 10:45:13 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:45:13 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/console.log" append="off"/>
Apr 17 10:45:13 user nova-compute[82522]:     </serial>
Apr 17 10:45:13 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:45:13 user nova-compute[82522]:     <video>
Apr 17 10:45:13 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:45:13 user nova-compute[82522]:     </video>
Apr 17 10:45:13 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:45:13 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:45:13 user nova-compute[82522]:     </rng>
Apr 17 10:45:13 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:45:13 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:45:13 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:45:13 user nova-compute[82522]:     </memballoon>
Apr 17 10:45:13 user nova-compute[82522]:   </devices>
Apr 17 10:45:13 user nova-compute[82522]: </domain>
Apr 17 10:45:13 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1414837798',display_name='tempest-VolumesActionsTest-instance-1414837798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1414837798',id=23,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b309bb2b37284020b81369ec89397374',ramdisk_id='',reservation_id='r-0r238meg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-505690119',owner_user_name='tempest-VolumesActionsTest-505690119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:45:11Z,user_data=None,user_id='ae91492cb6f342f58e250622e2a3ac11',uuid=9174e76f-1f0e-431c-b190-cb857eead406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converting VIF {"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:73:2b,bridge_name='br-int',has_traffic_filtering=True,id=d988d5c2-1a5a-425e-8dca-eee7b1783eae,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd988d5c2-1a') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG os_vif [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:73:2b,bridge_name='br-int',has_traffic_filtering=True,id=d988d5c2-1a5a-425e-8dca-eee7b1783eae,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd988d5c2-1a') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd988d5c2-1a, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd988d5c2-1a, col_values=(('external_ids', {'iface-id': 'd988d5c2-1a5a-425e-8dca-eee7b1783eae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:73:2b', 'vm-uuid': '9174e76f-1f0e-431c-b190-cb857eead406'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:13 user nova-compute[82522]: INFO os_vif [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:73:2b,bridge_name='br-int',has_traffic_filtering=True,id=d988d5c2-1a5a-425e-8dca-eee7b1783eae,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd988d5c2-1a')
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] No VIF found with MAC fa:16:3e:d3:73:2b, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.network.neutron [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Updated VIF entry in instance network info cache for port d988d5c2-1a5a-425e-8dca-eee7b1783eae. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG nova.network.neutron [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Updating instance_info_cache with network_info: [{"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] Releasing lock "refresh_cache-9174e76f-1f0e-431c-b190-cb857eead406" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:45:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received event network-vif-plugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] Acquiring lock "9174e76f-1f0e-431c-b190-cb857eead406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] No waiting events found dispatching network-vif-plugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:45:14 user nova-compute[82522]: WARNING nova.compute.manager [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received unexpected event network-vif-plugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance with vm_state building and task_state spawning.
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728316.637497, 9174e76f-1f0e-431c-b190-cb857eead406 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:45:16 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] VM Resumed (Lifecycle Event)
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:45:16 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Instance spawned successfully.
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:16 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728316.6412714, 9174e76f-1f0e-431c-b190-cb857eead406 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:45:16 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] VM Started (Lifecycle Event)
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:45:16 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:45:16 user nova-compute[82522]: INFO nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Took 5.62 seconds to spawn the instance on the hypervisor.
Apr 17 10:45:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:16 user nova-compute[82522]: INFO nova.compute.manager [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Took 6.39 seconds to build instance.
Apr 17 10:45:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "9174e76f-1f0e-431c-b190-cb857eead406" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.491s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received event network-vif-plugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] Acquiring lock "9174e76f-1f0e-431c-b190-cb857eead406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] No waiting events found dispatching network-vif-plugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:45:17 user nova-compute[82522]: WARNING nova.compute.manager [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received unexpected event network-vif-plugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance with vm_state active and task_state None.
Apr 17 10:45:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:19 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:19 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 10:45:21 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:21 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 10:45:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 10:45:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:22 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:23 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:45:23 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 10:45:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:45:26 user nova-compute[82522]: INFO nova.compute.claims [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Claim successful on node user
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:45:27 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:27 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8152MB free_disk=26.455047607421875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.policy [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 9174e76f-1f0e-431c-b190-cb857eead406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:45:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Creating image(s)
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk 1073741824" returned: 0 in 0.048s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Successfully created port: 67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Cannot resize image /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'migration_context' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Ensure instance console log exists: /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Successfully updated port: 67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-changed-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Refreshing instance network info cache due to event network-changed-67386c8f-911d-4398-b449-42af25f6afe3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:45:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance network_info: |[{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Refreshing network info cache for port 67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Start _get_guest_xml network_info=[{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:45:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-972682008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:45:29 user nova-compute[82522]:   <uuid>2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</uuid>
Apr 17 10:45:29 user nova-compute[82522]:   <name>instance-00000018</name>
Apr 17 10:45:29 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:45:29 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:45:29 user nova-compute[82522]:   <metadata>
Apr 17 10:45:29 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:45:29 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:45:29 user nova-compute[82522]:       <nova:name>tempest-ServerActionsTestJSON-server-972682008</nova:name>
Apr 17 10:45:29 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:45:29</nova:creationTime>
Apr 17 10:45:29 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:45:29 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:45:29 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:45:29 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:45:29 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:45:29 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:45:29 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:45:29 user nova-compute[82522]:       <nova:owner>
Apr 17 10:45:29 user nova-compute[82522]:         <nova:user uuid="a7e218d771db49e88d13d3b088f3d88a">tempest-ServerActionsTestJSON-2107442540-project-member</nova:user>
Apr 17 10:45:29 user nova-compute[82522]:         <nova:project uuid="cc1b39ff9581474b87c58164e5cafa00">tempest-ServerActionsTestJSON-2107442540</nova:project>
Apr 17 10:45:29 user nova-compute[82522]:       </nova:owner>
Apr 17 10:45:29 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:45:29 user nova-compute[82522]:       <nova:ports>
Apr 17 10:45:29 user nova-compute[82522]:         <nova:port uuid="67386c8f-911d-4398-b449-42af25f6afe3">
Apr 17 10:45:29 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:45:29 user nova-compute[82522]:         </nova:port>
Apr 17 10:45:29 user nova-compute[82522]:       </nova:ports>
Apr 17 10:45:29 user nova-compute[82522]:     </nova:instance>
Apr 17 10:45:29 user nova-compute[82522]:   </metadata>
Apr 17 10:45:29 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:45:29 user nova-compute[82522]:     <system>
Apr 17 10:45:29 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:45:29 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:45:29 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:45:29 user nova-compute[82522]:       <entry name="serial">2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</entry>
Apr 17 10:45:29 user nova-compute[82522]:       <entry name="uuid">2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</entry>
Apr 17 10:45:29 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:45:29 user nova-compute[82522]:     </system>
Apr 17 10:45:29 user nova-compute[82522]:   </sysinfo>
Apr 17 10:45:29 user nova-compute[82522]:   <os>
Apr 17 10:45:29 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:45:29 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:45:29 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:45:29 user nova-compute[82522]:   </os>
Apr 17 10:45:29 user nova-compute[82522]:   <features>
Apr 17 10:45:29 user nova-compute[82522]:     <acpi/>
Apr 17 10:45:29 user nova-compute[82522]:     <apic/>
Apr 17 10:45:29 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:45:29 user nova-compute[82522]:   </features>
Apr 17 10:45:29 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:45:29 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:45:29 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:45:29 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:45:29 user nova-compute[82522]:   </clock>
Apr 17 10:45:29 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:45:29 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:45:29 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:45:29 user nova-compute[82522]:   </cpu>
Apr 17 10:45:29 user nova-compute[82522]:   <devices>
Apr 17 10:45:29 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:45:29 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:45:29 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk"/>
Apr 17 10:45:29 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:45:29 user nova-compute[82522]:     </disk>
Apr 17 10:45:29 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:45:29 user nova-compute[82522]:       <mac address="fa:16:3e:d3:62:81"/>
Apr 17 10:45:29 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:45:29 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:45:29 user nova-compute[82522]:       <target dev="tap67386c8f-91"/>
Apr 17 10:45:29 user nova-compute[82522]:     </interface>
Apr 17 10:45:29 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:45:29 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/console.log" append="off"/>
Apr 17 10:45:29 user nova-compute[82522]:     </serial>
Apr 17 10:45:29 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:45:29 user nova-compute[82522]:     <video>
Apr 17 10:45:29 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:45:29 user nova-compute[82522]:     </video>
Apr 17 10:45:29 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:45:29 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:45:29 user nova-compute[82522]:     </rng>
Apr 17 10:45:29 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:45:29 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:45:29 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:45:29 user nova-compute[82522]:     </memballoon>
Apr 17 10:45:29 user nova-compute[82522]:   </devices>
Apr 17 10:45:29 user nova-compute[82522]: </domain>
Apr 17 10:45:29 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-972682008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG os_vif [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67386c8f-91, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67386c8f-91, col_values=(('external_ids', {'iface-id': '67386c8f-911d-4398-b449-42af25f6afe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:62:81', 'vm-uuid': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:29 user nova-compute[82522]: INFO os_vif [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91')
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No VIF found with MAC fa:16:3e:d3:62:81, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updated VIF entry in instance network info cache for port 67386c8f-911d-4398-b449-42af25f6afe3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:45:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:45:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:45:30 user nova-compute[82522]: WARNING nova.compute.manager [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state building and task_state spawning.
Apr 17 10:45:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728332.813737, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:45:32 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Resumed (Lifecycle Event)
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:45:32 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance spawned successfully.
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:45:32 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728332.8169885, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:45:32 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Started (Lifecycle Event)
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:45:32 user nova-compute[82522]: INFO nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:32 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:45:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:45:33 user nova-compute[82522]: WARNING nova.compute.manager [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state building and task_state spawning.
Apr 17 10:45:33 user nova-compute[82522]: INFO nova.compute.manager [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Took 6.69 seconds to build instance.
Apr 17 10:45:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.853s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:43 user nova-compute[82522]: DEBUG nova.compute.manager [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:45:43 user nova-compute[82522]: INFO nova.compute.manager [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] instance snapshotting
Apr 17 10:45:43 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Beginning live snapshot process
Apr 17 10:45:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json -f qcow2 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json -f qcow2 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpug50x1dd/f26d435d7b2d4644b522c90e699b1ef4.delta 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpug50x1dd/f26d435d7b2d4644b522c90e699b1ef4.delta 1073741824" returned: 0 in 0.050s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:44 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 17 10:45:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:45:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:45:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 17 10:45:45 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:45:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpug50x1dd/f26d435d7b2d4644b522c90e699b1ef4.delta /opt/stack/data/nova/instances/snapshots/tmpug50x1dd/f26d435d7b2d4644b522c90e699b1ef4 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpug50x1dd/f26d435d7b2d4644b522c90e699b1ef4.delta /opt/stack/data/nova/instances/snapshots/tmpug50x1dd/f26d435d7b2d4644b522c90e699b1ef4" returned: 0 in 0.310s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Snapshot extracted, beginning image upload
Apr 17 10:45:48 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Snapshot image upload complete
Apr 17 10:45:48 user nova-compute[82522]: INFO nova.compute.manager [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Took 5.04 seconds to snapshot the instance on the hypervisor.
Apr 17 10:45:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:52 user nova-compute[82522]: INFO nova.compute.manager [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Unshelving
Apr 17 10:45:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'pci_requests' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'numa_topology' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:45:52 user nova-compute[82522]: INFO nova.compute.claims [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Claim successful on node user
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:45:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:52 user nova-compute[82522]: INFO nova.network.neutron [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updating port 8541d98c-fcb7-4f1a-904c-97db8145dd29 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquired lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-changed-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Refreshing instance network info cache due to event network-changed-8541d98c-fcb7-4f1a-904c-97db8145dd29. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] Acquiring lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updating instance_info_cache with network_info: [{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Releasing lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:45:53 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Creating image(s)
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'trusted_certs' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] Acquired lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Refreshing network info cache for port 8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "8f89c096ce7bce3a99ad56932220e1a2413ff284" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "8f89c096ce7bce3a99ad56932220e1a2413ff284" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284.part --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG nova.virt.images [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] f64e76d4-2b30-4d49-984a-133a7b24e9da was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284.part /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284.part /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284.converted" returned: 0 in 0.177s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updated VIF entry in instance network info cache for port 8541d98c-fcb7-4f1a-904c-97db8145dd29. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updating instance_info_cache with network_info: [{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:45:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] Releasing lock "refresh_cache-288bc9dc-1698-4ca9-a670-5e219c04202b" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "8f89c096ce7bce3a99ad56932220e1a2413ff284" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.154s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284 --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "8f89c096ce7bce3a99ad56932220e1a2413ff284" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "8f89c096ce7bce3a99ad56932220e1a2413ff284" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284 --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284,backing_fmt=raw /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284,backing_fmt=raw /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk 1073741824" returned: 0 in 0.046s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "8f89c096ce7bce3a99ad56932220e1a2413ff284" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284 --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'migration_context' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:55 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Rebasing disk image.
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 -F raw /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 -F raw /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk" returned: 0 in 2.051s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Ensure instance console log exists: /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Start _get_guest_xml network_info=[{"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9773d41fc75ccb63b41c5de2b6d49c50',container_format='bare',created_at=2023-04-17T10:44:00Z,direct_url=<?>,disk_format='qcow2',id=f64e76d4-2b30-4d49-984a-133a7b24e9da,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1486235308-shelved',owner='e6dac880f4294283ae7838bfa0edf5c1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-17T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:45:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9773d41fc75ccb63b41c5de2b6d49c50',container_format='bare',created_at=2023-04-17T10:44:00Z,direct_url=<?>,disk_format='qcow2',id=f64e76d4-2b30-4d49-984a-133a7b24e9da,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1486235308-shelved',owner='e6dac880f4294283ae7838bfa0edf5c1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-17T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'vcpu_model' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486235308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486235308',id=18,image_ref='f64e76d4-2b30-4d49-984a-133a7b24e9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1963349943',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:42:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-nhvcv880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member',shelved_at='2023-04-17T10:44:03.592343',shelved_host='user',shelved_image_id='f64e76d4-2b30-4d49-984a-133a7b24e9da'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=288bc9dc-1698-4ca9-a670-5e219c04202b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'pci_devices' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:45:57 user nova-compute[82522]:   <uuid>288bc9dc-1698-4ca9-a670-5e219c04202b</uuid>
Apr 17 10:45:57 user nova-compute[82522]:   <name>instance-00000012</name>
Apr 17 10:45:57 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:45:57 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:45:57 user nova-compute[82522]:   <metadata>
Apr 17 10:45:57 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:45:57 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:45:57 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1486235308</nova:name>
Apr 17 10:45:57 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:45:57</nova:creationTime>
Apr 17 10:45:57 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:45:57 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:45:57 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:45:57 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:45:57 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:45:57 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:45:57 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:45:57 user nova-compute[82522]:       <nova:owner>
Apr 17 10:45:57 user nova-compute[82522]:         <nova:user uuid="aea97828312f45ffa1b7148c375a7f9a">tempest-AttachVolumeShelveTestJSON-1174346715-project-member</nova:user>
Apr 17 10:45:57 user nova-compute[82522]:         <nova:project uuid="e6dac880f4294283ae7838bfa0edf5c1">tempest-AttachVolumeShelveTestJSON-1174346715</nova:project>
Apr 17 10:45:57 user nova-compute[82522]:       </nova:owner>
Apr 17 10:45:57 user nova-compute[82522]:       <nova:root type="image" uuid="f64e76d4-2b30-4d49-984a-133a7b24e9da"/>
Apr 17 10:45:57 user nova-compute[82522]:       <nova:ports>
Apr 17 10:45:57 user nova-compute[82522]:         <nova:port uuid="8541d98c-fcb7-4f1a-904c-97db8145dd29">
Apr 17 10:45:57 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 17 10:45:57 user nova-compute[82522]:         </nova:port>
Apr 17 10:45:57 user nova-compute[82522]:       </nova:ports>
Apr 17 10:45:57 user nova-compute[82522]:     </nova:instance>
Apr 17 10:45:57 user nova-compute[82522]:   </metadata>
Apr 17 10:45:57 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:45:57 user nova-compute[82522]:     <system>
Apr 17 10:45:57 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:45:57 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:45:57 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:45:57 user nova-compute[82522]:       <entry name="serial">288bc9dc-1698-4ca9-a670-5e219c04202b</entry>
Apr 17 10:45:57 user nova-compute[82522]:       <entry name="uuid">288bc9dc-1698-4ca9-a670-5e219c04202b</entry>
Apr 17 10:45:57 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:45:57 user nova-compute[82522]:     </system>
Apr 17 10:45:57 user nova-compute[82522]:   </sysinfo>
Apr 17 10:45:57 user nova-compute[82522]:   <os>
Apr 17 10:45:57 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:45:57 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:45:57 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:45:57 user nova-compute[82522]:   </os>
Apr 17 10:45:57 user nova-compute[82522]:   <features>
Apr 17 10:45:57 user nova-compute[82522]:     <acpi/>
Apr 17 10:45:57 user nova-compute[82522]:     <apic/>
Apr 17 10:45:57 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:45:57 user nova-compute[82522]:   </features>
Apr 17 10:45:57 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:45:57 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:45:57 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:45:57 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:45:57 user nova-compute[82522]:   </clock>
Apr 17 10:45:57 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:45:57 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:45:57 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:45:57 user nova-compute[82522]:   </cpu>
Apr 17 10:45:57 user nova-compute[82522]:   <devices>
Apr 17 10:45:57 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:45:57 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:45:57 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk"/>
Apr 17 10:45:57 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:45:57 user nova-compute[82522]:     </disk>
Apr 17 10:45:57 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:45:57 user nova-compute[82522]:       <mac address="fa:16:3e:dc:2c:c6"/>
Apr 17 10:45:57 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:45:57 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:45:57 user nova-compute[82522]:       <target dev="tap8541d98c-fc"/>
Apr 17 10:45:57 user nova-compute[82522]:     </interface>
Apr 17 10:45:57 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:45:57 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/console.log" append="off"/>
Apr 17 10:45:57 user nova-compute[82522]:     </serial>
Apr 17 10:45:57 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:45:57 user nova-compute[82522]:     <video>
Apr 17 10:45:57 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:45:57 user nova-compute[82522]:     </video>
Apr 17 10:45:57 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:45:57 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:45:57 user nova-compute[82522]:     </rng>
Apr 17 10:45:57 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:45:57 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:45:57 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:45:57 user nova-compute[82522]:     </memballoon>
Apr 17 10:45:57 user nova-compute[82522]:   </devices>
Apr 17 10:45:57 user nova-compute[82522]: </domain>
Apr 17 10:45:57 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486235308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486235308',id=18,image_ref='f64e76d4-2b30-4d49-984a-133a7b24e9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1963349943',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:42:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-nhvcv880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member',shelved_at='2023-04-17T10:44:03.592343',shelved_host='user',shelved_image_id='f64e76d4-2b30-4d49-984a-133a7b24e9da'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=288bc9dc-1698-4ca9-a670-5e219c04202b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG os_vif [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8541d98c-fc, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8541d98c-fc, col_values=(('external_ids', {'iface-id': '8541d98c-fcb7-4f1a-904c-97db8145dd29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:2c:c6', 'vm-uuid': '288bc9dc-1698-4ca9-a670-5e219c04202b'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:57 user nova-compute[82522]: INFO os_vif [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc')
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:45:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] No VIF found with MAC fa:16:3e:dc:2c:c6, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:45:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG nova.compute.manager [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG nova.compute.manager [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] No waiting events found dispatching network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:45:59 user nova-compute[82522]: WARNING nova.compute.manager [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received unexpected event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 17 10:45:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:45:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728361.4062574, 288bc9dc-1698-4ca9-a670-5e219c04202b => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:46:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] VM Resumed (Lifecycle Event)
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:46:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance spawned successfully.
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:46:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728361.4079938, 288bc9dc-1698-4ca9-a670-5e219c04202b => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:46:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] VM Started (Lifecycle Event)
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:46:01 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:46:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] No waiting events found dispatching network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:46:01 user nova-compute[82522]: WARNING nova.compute.manager [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received unexpected event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 17 10:46:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:46:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.592s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:46:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:46:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:46:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:46:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:46:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:19 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:21 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received event network-changed-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:46:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Refreshing instance network info cache due to event network-changed-481e24d2-75a9-47c3-8d22-8573d260e7d3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:46:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] Acquiring lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:46:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] Acquired lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:46:21 user nova-compute[82522]: DEBUG nova.network.neutron [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Refreshing network info cache for port 481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG nova.objects.instance [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'flavor' on Instance uuid d61e9333-fe01-4a9e-abab-ef31ba6d4173 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:22 user nova-compute[82522]: INFO nova.compute.manager [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Attaching volume 7668fb8a-411e-4774-87c2-7029f4aa44ae to /dev/vdb
Apr 17 10:46:22 user nova-compute[82522]: DEBUG os_brick.utils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[580ff4ad-074a-4e22-b785-d6ea22663fee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c60481-ae85-4581-b969-53abcd3bceab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d61a2c1-4947-4e75-bf16-9958c596fcb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a6b5a2-703b-4412-9aa8-69c49dfd7a2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:46:22 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccedadd-3092-4738-8463-e0eb3e284556]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG os_brick.utils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updating existing volume attachment record: 8e9d8fb1-add4-41b2-97b3-1ced76ad84ad {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG nova.network.neutron [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updated VIF entry in instance network info cache for port 481e24d2-75a9-47c3-8d22-8573d260e7d3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG nova.network.neutron [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updating instance_info_cache with network_info: [{"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] Releasing lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:46:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 60008675-7786-4a26-9640-49da6efd0adb {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updating instance_info_cache with network_info: [{"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJRtOkBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:46:26 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:46:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:46:26 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:46:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:46:26 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5d2883-ca59-4819-b286-feec78f56ba6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:46:26 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[484b7e66-6a10-4a71-a4aa-42da8d3126a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae] added
Apr 17 10:46:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[32845df8-b200-4a62-891b-cc4aeebff45d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7532decf-96c6-41c4-af47-09cb1090c25b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJRtOkBG {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJRtOkBG" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[805f6b14-13cd-4686-a9f3-18dfe76d9981]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJRtOkBG'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[909dca47-92e5-4ada-ba61-97954c56cc54]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1e0cec-ef59-421d-b88b-45bf54fa544b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:46:27 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:46:27 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0f860b-a5aa-4beb-9b58-6b00918100b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae, portal: 172.16.0.220,3260]
Apr 17 10:46:27 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae, portal: 172.16.0.220,3260] successful.
Apr 17 10:46:27 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dd8c91-8a7e-4e22-ac0c-5317a9f53c32]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f573ca-3923-422c-8dd5-be92324be4a3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:46:27 user nova-compute[82522]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae (non-flash)
Apr 17 10:46:27 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:46:27 user nova-compute[82522]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae (non-flash)
Apr 17 10:46:27 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad1a1e7-3789-45eb-99cf-ce840c0f13b6]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJRtOkBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:46:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.763s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] <== connect_volume: return (1769ms) {'type': 'block', 'scsi_wwn': '23133323737343866', 'path': '/dev/sdc'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133323737343866', 'path': '/dev/sdc'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:46:28 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:46:28 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8012MB free_disk=26.360916137695312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.objects.instance [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'flavor' on Instance uuid d61e9333-fe01-4a9e-abab-ef31ba6d4173 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:46:28 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:46:28 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:46:28 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:46:28 user nova-compute[82522]:   <serial>7668fb8a-411e-4774-87c2-7029f4aa44ae</serial>
Apr 17 10:46:28 user nova-compute[82522]: </disk>
Apr 17 10:46:28 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 9174e76f-1f0e-431c-b190-cb857eead406 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 288bc9dc-1698-4ca9-a670-5e219c04202b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:46:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:46:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:29 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:46:29 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:46:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:46:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:46:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No VIF found with MAC fa:16:3e:5d:60:7d, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:46:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:46:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:46:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.007s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:46:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:31 user nova-compute[82522]: INFO nova.compute.manager [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Detaching volume 7668fb8a-411e-4774-87c2-7029f4aa44ae
Apr 17 10:46:31 user nova-compute[82522]: INFO nova.virt.block_device [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Attempting to driver detach volume 7668fb8a-411e-4774-87c2-7029f4aa44ae from mountpoint /dev/vdb
Apr 17 10:46:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Attempting to detach device vdb from instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:46:31 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:46:31 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:46:31 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:46:31 user nova-compute[82522]:   <serial>7668fb8a-411e-4774-87c2-7029f4aa44ae</serial>
Apr 17 10:46:31 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:46:31 user nova-compute[82522]: </disk>
Apr 17 10:46:31 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:46:31 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Successfully detached device vdb from instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 from the persistent domain config.
Apr 17 10:46:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:46:31 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:46:31 user nova-compute[82522]:   <source dev="/dev/sdc"/>
Apr 17 10:46:31 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:46:31 user nova-compute[82522]:   <serial>7668fb8a-411e-4774-87c2-7029f4aa44ae</serial>
Apr 17 10:46:31 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:46:31 user nova-compute[82522]: </disk>
Apr 17 10:46:31 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728391.6308017, d61e9333-fe01-4a9e-abab-ef31ba6d4173 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:46:31 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Successfully detached device vdb from instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 from the live domain config.
Apr 17 10:46:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJRtOkBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:46:31 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d2ed2-405f-4af9-b65d-6b2562340a66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:46:31 user nova-compute[82522]: No targets found.
Apr 17 10:46:31 user nova-compute[82522]: iSNS:
Apr 17 10:46:31 user nova-compute[82522]: No targets found.
Apr 17 10:46:31 user nova-compute[82522]: STATIC:
Apr 17 10:46:31 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae
Apr 17 10:46:31 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:46:31 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:46:31 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:46:31 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:46:31 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:46:31 user nova-compute[82522]: FIRMWARE:
Apr 17 10:46:31 user nova-compute[82522]: No targets found.
Apr 17 10:46:31 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:46:31 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:46:31 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16570a2-df42-49ed-8d68-304aa2332e06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e918d50-60d4-4b9f-9dd0-08033157a7a6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:46:31 user nova-compute[82522]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae (non-flash)
Apr 17 10:46:31 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:46:31 user nova-compute[82522]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae (non-flash)
Apr 17 10:46:31 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b4a92e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae'): ({'sdc'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Removing single pathed devices sdc {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33c1f1-7795-4f13-ad46-136c6fd17dbe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4397929e-7720-4b4b-8a6f-91f9816be38a]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flushing IO for device /dev/sdc {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43e78e5-01e0-4051-880e-666eb38a9b43]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4530b8-436f-43bd-b36e-2d04e02bc6b5]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8427a6b-f868-459d-89ba-09f998fa0be7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6905e6-1dcd-4f5d-8a77-e09570553cd1]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae, portal: 172.16.0.220,3260]
Apr 17 10:46:31 user nova-compute[82522]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae, portal: 172.16.0.220,3260] successful.
Apr 17 10:46:31 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7668fb8a-411e-4774-87c2-7029f4aa44ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[434d6329-932f-41aa-baa2-36e7d96604b9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] <== disconnect_volume: return (298ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:46:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:46:32 user nova-compute[82522]: DEBUG nova.objects.instance [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'flavor' on Instance uuid d61e9333-fe01-4a9e-abab-ef31ba6d4173 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:46:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:46:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:35 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:46:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "e198ad00-927f-45e1-9f14-828d56ce3393" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:46:50 user nova-compute[82522]: INFO nova.compute.claims [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Claim successful on node user
Apr 17 10:46:50 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:46:50 user nova-compute[82522]: DEBUG nova.network.neutron [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:46:50 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:46:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:46:50 user nova-compute[82522]: INFO nova.virt.block_device [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Booting with volume-backed-image 66764afd-311a-41a0-a068-b2937b23acba at /dev/vda
Apr 17 10:46:50 user nova-compute[82522]: DEBUG nova.policy [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:46:51 user nova-compute[82522]: DEBUG nova.network.neutron [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Successfully created port: 8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:46:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Successfully updated port: 8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:46:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:46:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquired lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:46:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:46:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-changed-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:46:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Refreshing instance network info cache due to event network-changed-8b03fa35-eaab-40ea-a06b-afa4bd410981. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:46:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] Acquiring lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:46:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:46:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:53 user nova-compute[82522]: DEBUG nova.network.neutron [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Updating instance_info_cache with network_info: [{"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:46:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Releasing lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:46:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Instance network_info: |[{"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:46:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] Acquired lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:46:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Refreshing network info cache for port 8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:46:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Updated VIF entry in instance network info cache for port 8b03fa35-eaab-40ea-a06b-afa4bd410981. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:46:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Updating instance_info_cache with network_info: [{"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:46:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] Releasing lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:46:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received event network-changed-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:46:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Refreshing instance network info cache due to event network-changed-20b83dbf-57d7-4d67-b030-53b0d12f01e2. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:46:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] Acquiring lock "refresh_cache-44e80daa-73f1-4b84-8cbc-3dd0ea159da3" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:46:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] Acquired lock "refresh_cache-44e80daa-73f1-4b84-8cbc-3dd0ea159da3" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:46:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Refreshing network info cache for port 20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:46:55 user nova-compute[82522]: DEBUG nova.network.neutron [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Updated VIF entry in instance network info cache for port 20b83dbf-57d7-4d67-b030-53b0d12f01e2. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:46:55 user nova-compute[82522]: DEBUG nova.network.neutron [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Updating instance_info_cache with network_info: [{"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:46:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] Releasing lock "refresh_cache-44e80daa-73f1-4b84-8cbc-3dd0ea159da3" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.utils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[73703ce1-483a-45e8-951b-1eb4a6c6c114]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e605e6-ed89-403a-8c3c-60b6e692511b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[29349fe1-2da8-4808-b52e-48fd222fad2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5c70b1-0aab-45bb-ad25-8bbcdd1b47fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:46:56 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6767977-2ac6-40a0-b404-26ec27bb82a3]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.utils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Updating existing volume attachment record: c95ba89b-da1a-4d19-9816-ffc2ce7d8593 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:46:56 user nova-compute[82522]: INFO nova.compute.manager [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Attaching volume 7c826238-b1c2-4c27-8619-39a2fcc30547 to /dev/vdb
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.utils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf46824a-f884-484f-8fa0-d498cded11ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc40c9e3-d4ec-4a4c-ad7c-4a0a5d7d2b27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[900c1eef-5545-4f6e-b555-b881b61b3f65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb8e311-f657-4b84-9851-bd672483a6d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:46:56 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:46:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a97e27-81ad-4cf2-ba8a-3031f2d96f93]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG os_brick.utils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:46:56 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Updating existing volume attachment record: c209a14c-ef94-4f64-bb47-f954a8acf1da {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:46:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:46:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:47:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Creating image(s)
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Ensure instance console log exists: /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Start _get_guest_xml network_info=[{"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'c95ba89b-da1a-4d19-9816-ffc2ce7d8593', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGHWqeyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e198ad00-927f-45e1-9f14-828d56ce3393', 'attached_at': '', 'detached_at': '', 'volume_id': '1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 'serial': '1b812f1c-bad0-4b89-b9b8-60c3ddc9669a'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:47:01 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:47:01 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGHWqeyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:47:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:47:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:47:01 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a724ccfa-7f80-4711-90f5-9d8300060cd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:47:01 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "9174e76f-1f0e-431c-b190-cb857eead406" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "9174e76f-1f0e-431c-b190-cb857eead406" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "9174e76f-1f0e-431c-b190-cb857eead406-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:01 user nova-compute[82522]: INFO nova.compute.manager [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Terminating instance
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPzhSbtX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:47:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c86595-007f-4f46-b375-94e65ab08e2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a] added
Apr 17 10:47:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fff4c03-0359-4adb-855e-a13999533a5c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e739809b-7b86-4fa2-b127-bb195742f2d0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGHWqeyL {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGHWqeyL" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27d5e6c-5946-4ef4-9450-358ca44a1263]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TGHWqeyL'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96c6cee-df5d-41be-8875-7fcd4c2399b3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cf68f9-955d-46bc-af52-ed52b5d4ae57]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7ddd98-60f6-4914-abba-9ad2bc7c4d93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a, portal: 172.16.0.220,3260]
Apr 17 10:47:01 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a, portal: 172.16.0.220,3260] successful.
Apr 17 10:47:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebcaf29-5638-4af0-a0b6-10124c8dfb58]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baad6e1-f6bb-4e42-8832-a162aad42a73]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:01 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:01 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received event network-vif-unplugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] Acquiring lock "9174e76f-1f0e-431c-b190-cb857eead406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] No waiting events found dispatching network-vif-unplugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received event network-vif-unplugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0795d51e-0628-47ed-bce1-ae8f659d675b]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGHWqeyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Instance destroyed successfully.
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.objects.instance [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lazy-loading 'resources' on Instance uuid 9174e76f-1f0e-431c-b190-cb857eead406 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1414837798',display_name='tempest-VolumesActionsTest-instance-1414837798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1414837798',id=23,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b309bb2b37284020b81369ec89397374',ramdisk_id='',reservation_id='r-0r238meg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-505690119',owner_user_name='tempest-VolumesActionsTest-505690119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:45:17Z,user_data=None,user_id='ae91492cb6f342f58e250622e2a3ac11',uuid=9174e76f-1f0e-431c-b190-cb857eead406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converting VIF {"id": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "address": "fa:16:3e:d3:73:2b", "network": {"id": "a617c444-412d-4406-abf8-e1e2f697247e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1347016191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b309bb2b37284020b81369ec89397374", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd988d5c2-1a", "ovs_interfaceid": "d988d5c2-1a5a-425e-8dca-eee7b1783eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:73:2b,bridge_name='br-int',has_traffic_filtering=True,id=d988d5c2-1a5a-425e-8dca-eee7b1783eae,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd988d5c2-1a') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG os_vif [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:73:2b,bridge_name='br-int',has_traffic_filtering=True,id=d988d5c2-1a5a-425e-8dca-eee7b1783eae,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd988d5c2-1a') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd988d5c2-1a, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:47:01 user nova-compute[82522]: INFO os_vif [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:73:2b,bridge_name='br-int',has_traffic_filtering=True,id=d988d5c2-1a5a-425e-8dca-eee7b1783eae,network=Network(a617c444-412d-4406-abf8-e1e2f697247e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd988d5c2-1a')
Apr 17 10:47:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Deleting instance files /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406_del
Apr 17 10:47:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Deletion of /opt/stack/data/nova/instances/9174e76f-1f0e-431c-b190-cb857eead406_del complete
Apr 17 10:47:02 user nova-compute[82522]: INFO nova.compute.manager [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received event network-vif-deleted-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:02 user nova-compute[82522]: INFO nova.compute.manager [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Neutron deleted interface d988d5c2-1a5a-425e-8dca-eee7b1783eae; detaching it from the instance and deleting it from the info cache
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.network.neutron [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:47:02 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Took 0.46 seconds to deallocate network for instance.
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Detach interface failed, port_id=d988d5c2-1a5a-425e-8dca-eee7b1783eae, reason: Instance 9174e76f-1f0e-431c-b190-cb857eead406 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23031663036643530', 'path': '/dev/sdc'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031663036643530', 'path': '/dev/sdc'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.273s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:47:02 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:47:02 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0556a9da-39df-46f6-adb6-b9138bf0663b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:47:02 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1712014270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1712014270',id=25,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-hhn6szt5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:46:51Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=e198ad00-927f-45e1-9f14-828d56ce3393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=8b03fa35-eaab-40ea-a06b-afa4bd410981,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b03fa35-ea') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.objects.instance [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'pci_devices' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad6a58f-0dc0-4c85-89ac-99bf75941548]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547] added
Apr 17 10:47:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:47:02 user nova-compute[82522]:   <uuid>e198ad00-927f-45e1-9f14-828d56ce3393</uuid>
Apr 17 10:47:02 user nova-compute[82522]:   <name>instance-00000019</name>
Apr 17 10:47:02 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:47:02 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:47:02 user nova-compute[82522]:   <metadata>
Apr 17 10:47:02 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:47:02 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:47:02 user nova-compute[82522]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1712014270</nova:name>
Apr 17 10:47:02 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:47:01</nova:creationTime>
Apr 17 10:47:02 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:47:02 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:47:02 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:47:02 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:47:02 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:47:02 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:47:02 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:47:02 user nova-compute[82522]:       <nova:owner>
Apr 17 10:47:02 user nova-compute[82522]:         <nova:user uuid="d8cb73d24d324903a625e4782270120e">tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member</nova:user>
Apr 17 10:47:02 user nova-compute[82522]:         <nova:project uuid="faab4afa0ddf45578232627c2fac2ff8">tempest-ServerBootFromVolumeStableRescueTest-933538997</nova:project>
Apr 17 10:47:02 user nova-compute[82522]:       </nova:owner>
Apr 17 10:47:02 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:47:02 user nova-compute[82522]:       <nova:ports>
Apr 17 10:47:02 user nova-compute[82522]:         <nova:port uuid="8b03fa35-eaab-40ea-a06b-afa4bd410981">
Apr 17 10:47:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 17 10:47:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:47:02 user nova-compute[82522]:       </nova:ports>
Apr 17 10:47:02 user nova-compute[82522]:     </nova:instance>
Apr 17 10:47:02 user nova-compute[82522]:   </metadata>
Apr 17 10:47:02 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:47:02 user nova-compute[82522]:     <system>
Apr 17 10:47:02 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:47:02 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:47:02 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:47:02 user nova-compute[82522]:       <entry name="serial">e198ad00-927f-45e1-9f14-828d56ce3393</entry>
Apr 17 10:47:02 user nova-compute[82522]:       <entry name="uuid">e198ad00-927f-45e1-9f14-828d56ce3393</entry>
Apr 17 10:47:02 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:47:02 user nova-compute[82522]:     </system>
Apr 17 10:47:02 user nova-compute[82522]:   </sysinfo>
Apr 17 10:47:02 user nova-compute[82522]:   <os>
Apr 17 10:47:02 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:47:02 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:47:02 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:47:02 user nova-compute[82522]:   </os>
Apr 17 10:47:02 user nova-compute[82522]:   <features>
Apr 17 10:47:02 user nova-compute[82522]:     <acpi/>
Apr 17 10:47:02 user nova-compute[82522]:     <apic/>
Apr 17 10:47:02 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:47:02 user nova-compute[82522]:   </features>
Apr 17 10:47:02 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:47:02 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:47:02 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:47:02 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:47:02 user nova-compute[82522]:   </clock>
Apr 17 10:47:02 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:47:02 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:47:02 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:47:02 user nova-compute[82522]:   </cpu>
Apr 17 10:47:02 user nova-compute[82522]:   <devices>
Apr 17 10:47:02 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:47:02 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:47:02 user nova-compute[82522]:       <source dev="/dev/sdc"/>
Apr 17 10:47:02 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:47:02 user nova-compute[82522]:       <serial>1b812f1c-bad0-4b89-b9b8-60c3ddc9669a</serial>
Apr 17 10:47:02 user nova-compute[82522]:     </disk>
Apr 17 10:47:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:47:02 user nova-compute[82522]:       <mac address="fa:16:3e:03:f3:95"/>
Apr 17 10:47:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:47:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:47:02 user nova-compute[82522]:       <target dev="tap8b03fa35-ea"/>
Apr 17 10:47:02 user nova-compute[82522]:     </interface>
Apr 17 10:47:02 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:47:02 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/console.log" append="off"/>
Apr 17 10:47:02 user nova-compute[82522]:     </serial>
Apr 17 10:47:02 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:47:02 user nova-compute[82522]:     <video>
Apr 17 10:47:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:47:02 user nova-compute[82522]:     </video>
Apr 17 10:47:02 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:47:02 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:47:02 user nova-compute[82522]:     </rng>
Apr 17 10:47:02 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:47:02 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:47:02 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:47:02 user nova-compute[82522]:     </memballoon>
Apr 17 10:47:02 user nova-compute[82522]:   </devices>
Apr 17 10:47:02 user nova-compute[82522]: </domain>
Apr 17 10:47:02 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1712014270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1712014270',id=25,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-hhn6szt5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:46:51Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=e198ad00-927f-45e1-9f14-828d56ce3393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=8b03fa35-eaab-40ea-a06b-afa4bd410981,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b03fa35-ea') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_vif [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=8b03fa35-eaab-40ea-a06b-afa4bd410981,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b03fa35-ea') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b03fa35-ea, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b03fa35-ea, col_values=(('external_ids', {'iface-id': '8b03fa35-eaab-40ea-a06b-afa4bd410981', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:f3:95', 'vm-uuid': 'e198ad00-927f-45e1-9f14-828d56ce3393'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3237e-c6d5-4163-8a3c-10dff1604e0e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: INFO os_vif [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=8b03fa35-eaab-40ea-a06b-afa4bd410981,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b03fa35-ea')
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fea21f5-477a-4356-bb08-ec525f68210b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPzhSbtX {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPzhSbtX" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cd9086-5f37-4e71-aabc-a8198fef2e21]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pPzhSbtX'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No VIF found with MAC fa:16:3e:03:f3:95, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9767ae7e-ccf8-4882-a5c4-936216e8e7ef]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5244c9-541f-4a4a-8952-762211b3e7c6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:02 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:02 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41623e7-fe25-449f-87d4-5930c29abfe6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547, portal: 172.16.0.220,3260]
Apr 17 10:47:02 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547, portal: 172.16.0.220,3260] successful.
Apr 17 10:47:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f505b731-3afd-4f1a-9d3a-534a94c6f6e9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b37b1e-3dc8-4685-93e0-c980e2ea368b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:02 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:02 user nova-compute[82522]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)
Apr 17 10:47:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:02 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:02 user nova-compute[82522]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)
Apr 17 10:47:02 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:47:02 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Deleted allocations for instance 9174e76f-1f0e-431c-b190-cb857eead406
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b062e491-c044-4e25-8f8b-07247407333e]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:47:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPzhSbtX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:47:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "9174e76f-1f0e-431c-b190-cb857eead406" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.686s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received event network-vif-plugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] Acquiring lock "9174e76f-1f0e-431c-b190-cb857eead406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] Lock "9174e76f-1f0e-431c-b190-cb857eead406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] No waiting events found dispatching network-vif-plugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:03 user nova-compute[82522]: WARNING nova.compute.manager [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Received unexpected event network-vif-plugged-d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance with vm_state deleted and task_state None.
Apr 17 10:47:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:47:03 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== connect_volume: return (2606ms) {'type': 'block', 'scsi_wwn': '23138336265663766', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:47:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138336265663766', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:47:03 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:47:04 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:47:04 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:47:04 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:47:04 user nova-compute[82522]:   <serial>7c826238-b1c2-4c27-8619-39a2fcc30547</serial>
Apr 17 10:47:04 user nova-compute[82522]: </disk>
Apr 17 10:47:04 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:04 user nova-compute[82522]: WARNING nova.compute.manager [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state building and task_state spawning.
Apr 17 10:47:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No VIF found with MAC fa:16:3e:c3:51:8a, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:47:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.153s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:06 user nova-compute[82522]: WARNING nova.compute.manager [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state building and task_state spawning.
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728426.4008112, e198ad00-927f-45e1-9f14-828d56ce3393 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:47:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] VM Resumed (Lifecycle Event)
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:47:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Instance spawned successfully.
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:47:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728426.401842, e198ad00-927f-45e1-9f14-828d56ce3393 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:47:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] VM Started (Lifecycle Event)
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:47:06 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:47:06 user nova-compute[82522]: INFO nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 17 10:47:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:06 user nova-compute[82522]: INFO nova.compute.manager [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Took 16.32 seconds to build instance.
Apr 17 10:47:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "e198ad00-927f-45e1-9f14-828d56ce3393" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.406s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:07 user nova-compute[82522]: DEBUG nova.objects.instance [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:08 user nova-compute[82522]: INFO nova.compute.manager [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Attaching volume 2ce28870-51bb-4d74-988a-0bbecf6e1576 to /dev/vdc
Apr 17 10:47:08 user nova-compute[82522]: DEBUG os_brick.utils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef0bc57-7e7f-401a-989e-03a4a46b1034]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a452dc-d0e5-4811-809a-ff586aaacab7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc1436-404c-4985-88c3-c241283b3856]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[24093bce-b769-42f1-85b9-0f1c8e160d6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:47:08 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:47:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa90c1d-49b8-4223-bdb4-3bfc08e70c09]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG os_brick.utils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:47:08 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Updating existing volume attachment record: e02a4527-6864-47ab-8955-d1789c4b04eb {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:47:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnVeLYUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:47:12 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:47:12 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:47:12 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5469a3f-785c-454e-bf95-b23bbddacc83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:47:12 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1848eb-367c-4d24-bc1c-bc05e14a072c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576] added
Apr 17 10:47:12 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb1143-0646-475c-bc80-03cc19e9cf08]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d608ae-59ac-4063-afab-f2fa7069b145]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnVeLYUQ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnVeLYUQ" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad211b6-ed93-4b6a-b443-89b05f889191]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XnVeLYUQ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f10650-8820-4e4f-bda2-1850f60d19f9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c902127-baea-4673-afd0-940d2d2e77a8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[afee4d31-ae87-4528-bb98-c44367a10a94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576, portal: 172.16.0.220,3260]
Apr 17 10:47:13 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576, portal: 172.16.0.220,3260] successful.
Apr 17 10:47:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da1408-b626-4d86-b581-f22a6c3fe53c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1e45b1-1e35-47bf-bd2e-e7e2161b0a8e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 (non-flash)
Apr 17 10:47:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d9694e-c1f0-4be6-9bfe-2647e2e73228]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:47:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnVeLYUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23730316662613831', 'path': '/dev/sde'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730316662613831', 'path': '/dev/sde'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG nova.objects.instance [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:47:14 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:47:14 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:47:14 user nova-compute[82522]:   <target dev="vdc" bus="virtio"/>
Apr 17 10:47:14 user nova-compute[82522]:   <serial>2ce28870-51bb-4d74-988a-0bbecf6e1576</serial>
Apr 17 10:47:14 user nova-compute[82522]: </disk>
Apr 17 10:47:14 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] No VIF found with MAC fa:16:3e:c3:51:8a, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:47:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.711s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:15 user nova-compute[82522]: INFO nova.compute.manager [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Detaching volume 7c826238-b1c2-4c27-8619-39a2fcc30547
Apr 17 10:47:15 user nova-compute[82522]: INFO nova.virt.block_device [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Attempting to driver detach volume 7c826238-b1c2-4c27-8619-39a2fcc30547 from mountpoint /dev/vdb
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Attempting to detach device vdb from instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:47:16 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:47:16 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:47:16 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:47:16 user nova-compute[82522]:   <serial>7c826238-b1c2-4c27-8619-39a2fcc30547</serial>
Apr 17 10:47:16 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:47:16 user nova-compute[82522]: </disk>
Apr 17 10:47:16 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:47:16 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully detached device vdb from instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 from the persistent domain config.
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:47:16 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:47:16 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:47:16 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:47:16 user nova-compute[82522]:   <serial>7c826238-b1c2-4c27-8619-39a2fcc30547</serial>
Apr 17 10:47:16 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:47:16 user nova-compute[82522]: </disk>
Apr 17 10:47:16 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728436.478718, 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:47:16 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully detached device vdb from instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 from the live domain config.
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPzhSbtX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:47:16 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2315284-2dbf-4f8f-a53c-816911e2cb4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:47:16 user nova-compute[82522]: No targets found.
Apr 17 10:47:16 user nova-compute[82522]: iSNS:
Apr 17 10:47:16 user nova-compute[82522]: No targets found.
Apr 17 10:47:16 user nova-compute[82522]: STATIC:
Apr 17 10:47:16 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576
Apr 17 10:47:16 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:47:16 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:47:16 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547
Apr 17 10:47:16 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:47:16 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:47:16 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:47:16 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:47:16 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:47:16 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:47:16 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:47:16 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:47:16 user nova-compute[82522]: FIRMWARE:
Apr 17 10:47:16 user nova-compute[82522]: No targets found.
Apr 17 10:47:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:47:16 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:47:16 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea0de56-0f73-4fa9-9d62-2a22ad5abd2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28bc0fa-ef47-479b-9efe-c609f8db690c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:16 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:16 user nova-compute[82522]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)
Apr 17 10:47:16 user nova-compute[82522]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 (non-flash)
Apr 17 10:47:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:16 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:16 user nova-compute[82522]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 (non-flash)
Apr 17 10:47:16 user nova-compute[82522]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 (non-flash)
Apr 17 10:47:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28469b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547'): ({'sdd'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Removing single pathed devices sdd {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8696896a-157b-4827-83d0-5f3d894f6580]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9c521d-f0af-492a-bda6-092dcbf88e22]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flushing IO for device /dev/sdd {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1392c4-629a-4eaa-9de2-217f95db554f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6205a38e-0bd6-4689-a79e-07a21db37393]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabd618d-4dbb-47b0-89aa-4df4c124be73]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a39e89-3acd-485f-8690-d56b4093ed9e]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547, portal: 172.16.0.220,3260]
Apr 17 10:47:16 user nova-compute[82522]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547, portal: 172.16.0.220,3260] successful.
Apr 17 10:47:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c826238-b1c2-4c27-8619-39a2fcc30547 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5b72d-254a-4677-be14-01fa0fce16ae]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== disconnect_volume: return (294ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728421.9236367, 9174e76f-1f0e-431c-b190-cb857eead406 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:47:16 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] VM Stopped (Lifecycle Event)
Apr 17 10:47:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52024a18-5854-468f-aba7-62d324140a7f None None] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-changed-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Refreshing instance network info cache due to event network-changed-67386c8f-911d-4398-b449-42af25f6afe3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:47:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:47:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:47:17 user nova-compute[82522]: DEBUG nova.network.neutron [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Refreshing network info cache for port 67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:47:17 user nova-compute[82522]: DEBUG nova.objects.instance [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.777s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG nova.network.neutron [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updated VIF entry in instance network info cache for port 67386c8f-911d-4398-b449-42af25f6afe3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG nova.network.neutron [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:18 user nova-compute[82522]: INFO nova.compute.manager [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Detaching volume 2ce28870-51bb-4d74-988a-0bbecf6e1576
Apr 17 10:47:18 user nova-compute[82522]: INFO nova.virt.block_device [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Attempting to driver detach volume 2ce28870-51bb-4d74-988a-0bbecf6e1576 from mountpoint /dev/vdc
Apr 17 10:47:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Attempting to detach device vdc from instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:47:18 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:47:18 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:47:18 user nova-compute[82522]:   <target dev="vdc" bus="virtio"/>
Apr 17 10:47:18 user nova-compute[82522]:   <serial>2ce28870-51bb-4d74-988a-0bbecf6e1576</serial>
Apr 17 10:47:18 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 17 10:47:18 user nova-compute[82522]: </disk>
Apr 17 10:47:18 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:47:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully detached device vdc from instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 from the persistent domain config.
Apr 17 10:47:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:47:18 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:47:18 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:47:18 user nova-compute[82522]:   <target dev="vdc" bus="virtio"/>
Apr 17 10:47:18 user nova-compute[82522]:   <serial>2ce28870-51bb-4d74-988a-0bbecf6e1576</serial>
Apr 17 10:47:18 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 17 10:47:18 user nova-compute[82522]: </disk>
Apr 17 10:47:18 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728438.878244, 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:47:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully detached device vdc from instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 from the live domain config.
Apr 17 10:47:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnVeLYUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:47:18 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2bd3c5-32d3-4ccc-9363-cb0140cfd042]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:47:18 user nova-compute[82522]: No targets found.
Apr 17 10:47:18 user nova-compute[82522]: iSNS:
Apr 17 10:47:18 user nova-compute[82522]: No targets found.
Apr 17 10:47:18 user nova-compute[82522]: STATIC:
Apr 17 10:47:18 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576
Apr 17 10:47:18 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:47:18 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:47:18 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:47:18 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:47:18 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:47:18 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:47:18 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:47:18 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:47:18 user nova-compute[82522]: FIRMWARE:
Apr 17 10:47:18 user nova-compute[82522]: No targets found.
Apr 17 10:47:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:47:18 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:47:18 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c0f13-88f6-473c-b336-1110e895db02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[343aef93-eba1-4424-90b4-fd6f3ae2aa93]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:18 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:18 user nova-compute[82522]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 (non-flash)
Apr 17 10:47:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:47:18 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:47:18 user nova-compute[82522]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 (non-flash)
Apr 17 10:47:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2844ad2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576'): ({'sde'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Removing single pathed devices sde {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ba105-49b5-47bf-b2cf-5f2da0e86d15]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a1827d-cd2e-4cc2-87f4-621e142ff059]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flushing IO for device /dev/sde {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a75bfd8-6abc-4f7f-a9b8-331c78ee4955]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de14c55-6b68-4fb8-b46f-0663e9584591]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[95619ae0-a704-47b2-9fbf-e2c84c59dbe6]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf91026-0c64-43f9-88ae-8419f8b8d563]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576, portal: 172.16.0.220,3260]
Apr 17 10:47:19 user nova-compute[82522]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576, portal: 172.16.0.220,3260] successful.
Apr 17 10:47:19 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ce28870-51bb-4d74-988a-0bbecf6e1576 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2fcf45-6558-49f9-8618-af3691783956]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] <== disconnect_volume: return (303ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG nova.objects.instance [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'flavor' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.645s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:47:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:20 user nova-compute[82522]: INFO nova.compute.manager [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Terminating instance
Apr 17 10:47:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received event network-vif-unplugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] No waiting events found dispatching network-vif-unplugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received event network-vif-unplugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:47:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Instance destroyed successfully.
Apr 17 10:47:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'resources' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1717620221',display_name='tempest-AttachVolumeTestJSON-server-1717620221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1717620221',id=22,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2zQYbD7AeLgZmChqO+D6PkkPLUnwIfI8qHYFWa2oQb85VVSXg9rCtBd8+F+B7OSL/DhEpq2QZwWqNC6GQai65/T4R6/KjN1qcR2Nh9LeePxLKBQPRrXkccsLFsLvoclQ==',key_name='tempest-keypair-126931336',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a17ec3e1b314acbb701f2d2d27d0560',ramdisk_id='',reservation_id='r-h6ohd45e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2096000567',owner_user_name='tempest-AttachVolumeTestJSON-2096000567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9862432f87f4500a46f32a0b27d54d4',uuid=44e80daa-73f1-4b84-8cbc-3dd0ea159da3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converting VIF {"id": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "address": "fa:16:3e:c3:51:8a", "network": {"id": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-306857921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a17ec3e1b314acbb701f2d2d27d0560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b83dbf-57", "ovs_interfaceid": "20b83dbf-57d7-4d67-b030-53b0d12f01e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:8a,bridge_name='br-int',has_traffic_filtering=True,id=20b83dbf-57d7-4d67-b030-53b0d12f01e2,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b83dbf-57') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG os_vif [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:8a,bridge_name='br-int',has_traffic_filtering=True,id=20b83dbf-57d7-4d67-b030-53b0d12f01e2,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b83dbf-57') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20b83dbf-57, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:47:21 user nova-compute[82522]: INFO os_vif [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:8a,bridge_name='br-int',has_traffic_filtering=True,id=20b83dbf-57d7-4d67-b030-53b0d12f01e2,network=Network(9950f007-dbcc-4b9f-911a-7bd6a67f2c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b83dbf-57')
Apr 17 10:47:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Deleting instance files /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3_del
Apr 17 10:47:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Deletion of /opt/stack/data/nova/instances/44e80daa-73f1-4b84-8cbc-3dd0ea159da3_del complete
Apr 17 10:47:21 user nova-compute[82522]: INFO nova.compute.manager [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 17 10:47:21 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:47:21 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:47:22 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:47:22 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:47:22 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Took 0.68 seconds to deallocate network for instance.
Apr 17 10:47:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.691s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:23 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Deleted allocations for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3
Apr 17 10:47:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received event network-vif-plugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] Acquiring lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] No waiting events found dispatching network-vif-plugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:23 user nova-compute[82522]: WARNING nova.compute.manager [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received unexpected event network-vif-plugged-20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance with vm_state deleted and task_state None.
Apr 17 10:47:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Received event network-vif-deleted-20b83dbf-57d7-4d67-b030-53b0d12f01e2 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "44e80daa-73f1-4b84-8cbc-3dd0ea159da3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:47:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:25 user nova-compute[82522]: INFO nova.compute.manager [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] instance snapshotting
Apr 17 10:47:25 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Beginning live snapshot process
Apr 17 10:47:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json -f qcow2 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json -f qcow2 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpog5ljzx0/4f87e0e68f594f7ab7455f85a96e2d8b.delta 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpog5ljzx0/4f87e0e68f594f7ab7455f85a96e2d8b.delta 1073741824" returned: 0 in 0.052s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:26 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 17 10:47:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:47:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=82522) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 10:47:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpog5ljzx0/4f87e0e68f594f7ab7455f85a96e2d8b.delta /opt/stack/data/nova/instances/snapshots/tmpog5ljzx0/4f87e0e68f594f7ab7455f85a96e2d8b {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpog5ljzx0/4f87e0e68f594f7ab7455f85a96e2d8b.delta /opt/stack/data/nova/instances/snapshots/tmpog5ljzx0/4f87e0e68f594f7ab7455f85a96e2d8b" returned: 0 in 0.212s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Snapshot extracted, beginning image upload
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:47:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8007MB free_disk=26.395397186279297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 288bc9dc-1698-4ca9-a670-5e219c04202b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e198ad00-927f-45e1-9f14-828d56ce3393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:47:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:29 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Snapshot image upload complete
Apr 17 10:47:29 user nova-compute[82522]: INFO nova.compute.manager [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Took 4.42 seconds to snapshot the instance on the hypervisor.
Apr 17 10:47:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:47:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:47:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:47:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:47:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:47:30 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:47:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating instance_info_cache with network_info: [{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:47:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:47:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:47:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:47:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:47:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:47:35 user nova-compute[82522]: INFO nova.compute.claims [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Claim successful on node user
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:47:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.policy [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:47:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Creating image(s)
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "/opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "/opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "/opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "5bf740b60e3000cf6a600bf7aab69bdf5f20b6da" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "5bf740b60e3000cf6a600bf7aab69bdf5f20b6da" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:36 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Successfully created port: d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:47:36 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728441.7196631, 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:47:36 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] VM Stopped (Lifecycle Event)
Apr 17 10:47:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e1275a12-4b39-41f7-aeb3-70821c6ac004 None None] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da.part --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:36 user nova-compute[82522]: DEBUG nova.virt.images [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] fa787c35-c17b-4909-bc09-897818a6156f was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:47:36 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:47:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da.part /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da.part /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da.converted" returned: 0 in 0.407s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "5bf740b60e3000cf6a600bf7aab69bdf5f20b6da" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.382s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Successfully updated port: d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "5bf740b60e3000cf6a600bf7aab69bdf5f20b6da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "5bf740b60e3000cf6a600bf7aab69bdf5f20b6da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received event network-changed-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Refreshing instance network info cache due to event network-changed-d676d231-6c3e-427a-83f1-caab25925cd6. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] Acquiring lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] Acquired lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Refreshing network info cache for port d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da,backing_fmt=raw /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da,backing_fmt=raw /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk 1073741824" returned: 0 in 0.059s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "5bf740b60e3000cf6a600bf7aab69bdf5f20b6da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'migration_context' on Instance uuid a23c573c-7547-4739-bf72-ad8fa8fab7ed {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] Releasing lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquired lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Ensure instance console log exists: /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:37 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Updating instance_info_cache with network_info: [{"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Releasing lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Instance network_info: |[{"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Start _get_guest_xml network_info=[{"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b2f5ff8c16d023cc6de2ac022bf796a6',container_format='bare',created_at=2023-04-17T10:47:25Z,direct_url=<?>,disk_format='qcow2',id=fa787c35-c17b-4909-bc09-897818a6156f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1208638594',owner='84cd384dfcbb4739b9694704c1fad001',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-17T10:47:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': 'fa787c35-c17b-4909-bc09-897818a6156f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:47:38 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:47:38 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b2f5ff8c16d023cc6de2ac022bf796a6',container_format='bare',created_at=2023-04-17T10:47:25Z,direct_url=<?>,disk_format='qcow2',id=fa787c35-c17b-4909-bc09-897818a6156f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1208638594',owner='84cd384dfcbb4739b9694704c1fad001',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-17T10:47:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-766687741',display_name='tempest-TestStampPattern-server-766687741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-766687741',id=26,image_ref='fa787c35-c17b-4909-bc09-897818a6156f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuLQDJ2Z2AMQjPcpwBXxC60PoD0xwIae5XZ5z7x5L/fK+zl+/qEVvPMCnw86sAZZJR+5qNlBLSq4czZc4jysEkTXetR347vw/3aJ1wazOlhSEz/iMS3Zyr7Za5/g937hg==',key_name='tempest-TestStampPattern-12722321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84cd384dfcbb4739b9694704c1fad001',ramdisk_id='',reservation_id='r-34sg9hkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d61e9333-fe01-4a9e-abab-ef31ba6d4173',image_min_disk='1',image_min_ram='0',image_owner_id='84cd384dfcbb4739b9694704c1fad001',image_owner_project_name='tempest-TestStampPattern-2056640667',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2056640667-project-member',image_user_id='708740584a3d488da0ee13e5f8299b7f',network_allocated='True',owner_project_name='tempest-TestStampPattern-2056640667',owner_user_name='tempest-TestStampPattern-2056640667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:47:36Z,user_data=None,user_id='708740584a3d488da0ee13e5f8299b7f',uuid=a23c573c-7547-4739-bf72-ad8fa8fab7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converting VIF {"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=d676d231-6c3e-427a-83f1-caab25925cd6,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd676d231-6c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'pci_devices' on Instance uuid a23c573c-7547-4739-bf72-ad8fa8fab7ed {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:47:38 user nova-compute[82522]:   <uuid>a23c573c-7547-4739-bf72-ad8fa8fab7ed</uuid>
Apr 17 10:47:38 user nova-compute[82522]:   <name>instance-0000001a</name>
Apr 17 10:47:38 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:47:38 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:47:38 user nova-compute[82522]:   <metadata>
Apr 17 10:47:38 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:47:38 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:47:38 user nova-compute[82522]:       <nova:name>tempest-TestStampPattern-server-766687741</nova:name>
Apr 17 10:47:38 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:47:38</nova:creationTime>
Apr 17 10:47:38 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:47:38 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:47:38 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:47:38 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:47:38 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:47:38 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:47:38 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:47:38 user nova-compute[82522]:       <nova:owner>
Apr 17 10:47:38 user nova-compute[82522]:         <nova:user uuid="708740584a3d488da0ee13e5f8299b7f">tempest-TestStampPattern-2056640667-project-member</nova:user>
Apr 17 10:47:38 user nova-compute[82522]:         <nova:project uuid="84cd384dfcbb4739b9694704c1fad001">tempest-TestStampPattern-2056640667</nova:project>
Apr 17 10:47:38 user nova-compute[82522]:       </nova:owner>
Apr 17 10:47:38 user nova-compute[82522]:       <nova:root type="image" uuid="fa787c35-c17b-4909-bc09-897818a6156f"/>
Apr 17 10:47:38 user nova-compute[82522]:       <nova:ports>
Apr 17 10:47:38 user nova-compute[82522]:         <nova:port uuid="d676d231-6c3e-427a-83f1-caab25925cd6">
Apr 17 10:47:38 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 17 10:47:38 user nova-compute[82522]:         </nova:port>
Apr 17 10:47:38 user nova-compute[82522]:       </nova:ports>
Apr 17 10:47:38 user nova-compute[82522]:     </nova:instance>
Apr 17 10:47:38 user nova-compute[82522]:   </metadata>
Apr 17 10:47:38 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:47:38 user nova-compute[82522]:     <system>
Apr 17 10:47:38 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:47:38 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:47:38 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:47:38 user nova-compute[82522]:       <entry name="serial">a23c573c-7547-4739-bf72-ad8fa8fab7ed</entry>
Apr 17 10:47:38 user nova-compute[82522]:       <entry name="uuid">a23c573c-7547-4739-bf72-ad8fa8fab7ed</entry>
Apr 17 10:47:38 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:47:38 user nova-compute[82522]:     </system>
Apr 17 10:47:38 user nova-compute[82522]:   </sysinfo>
Apr 17 10:47:38 user nova-compute[82522]:   <os>
Apr 17 10:47:38 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:47:38 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:47:38 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:47:38 user nova-compute[82522]:   </os>
Apr 17 10:47:38 user nova-compute[82522]:   <features>
Apr 17 10:47:38 user nova-compute[82522]:     <acpi/>
Apr 17 10:47:38 user nova-compute[82522]:     <apic/>
Apr 17 10:47:38 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:47:38 user nova-compute[82522]:   </features>
Apr 17 10:47:38 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:47:38 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:47:38 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:47:38 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:47:38 user nova-compute[82522]:   </clock>
Apr 17 10:47:38 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:47:38 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:47:38 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:47:38 user nova-compute[82522]:   </cpu>
Apr 17 10:47:38 user nova-compute[82522]:   <devices>
Apr 17 10:47:38 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:47:38 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:47:38 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk"/>
Apr 17 10:47:38 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:47:38 user nova-compute[82522]:     </disk>
Apr 17 10:47:38 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:47:38 user nova-compute[82522]:       <mac address="fa:16:3e:73:76:0b"/>
Apr 17 10:47:38 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:47:38 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:47:38 user nova-compute[82522]:       <target dev="tapd676d231-6c"/>
Apr 17 10:47:38 user nova-compute[82522]:     </interface>
Apr 17 10:47:38 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:47:38 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/console.log" append="off"/>
Apr 17 10:47:38 user nova-compute[82522]:     </serial>
Apr 17 10:47:38 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:47:38 user nova-compute[82522]:     <video>
Apr 17 10:47:38 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:47:38 user nova-compute[82522]:     </video>
Apr 17 10:47:38 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:47:38 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:47:38 user nova-compute[82522]:     </rng>
Apr 17 10:47:38 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:47:38 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:47:38 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:47:38 user nova-compute[82522]:     </memballoon>
Apr 17 10:47:38 user nova-compute[82522]:   </devices>
Apr 17 10:47:38 user nova-compute[82522]: </domain>
Apr 17 10:47:38 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-766687741',display_name='tempest-TestStampPattern-server-766687741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-766687741',id=26,image_ref='fa787c35-c17b-4909-bc09-897818a6156f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuLQDJ2Z2AMQjPcpwBXxC60PoD0xwIae5XZ5z7x5L/fK+zl+/qEVvPMCnw86sAZZJR+5qNlBLSq4czZc4jysEkTXetR347vw/3aJ1wazOlhSEz/iMS3Zyr7Za5/g937hg==',key_name='tempest-TestStampPattern-12722321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84cd384dfcbb4739b9694704c1fad001',ramdisk_id='',reservation_id='r-34sg9hkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d61e9333-fe01-4a9e-abab-ef31ba6d4173',image_min_disk='1',image_min_ram='0',image_owner_id='84cd384dfcbb4739b9694704c1fad001',image_owner_project_name='tempest-TestStampPattern-2056640667',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2056640667-project-member',image_user_id='708740584a3d488da0ee13e5f8299b7f',network_allocated='True',owner_project_name='tempest-TestStampPattern-2056640667',owner_user_name='tempest-TestStampPattern-2056640667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:47:36Z,user_data=None,user_id='708740584a3d488da0ee13e5f8299b7f',uuid=a23c573c-7547-4739-bf72-ad8fa8fab7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converting VIF {"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=d676d231-6c3e-427a-83f1-caab25925cd6,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd676d231-6c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG os_vif [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=d676d231-6c3e-427a-83f1-caab25925cd6,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd676d231-6c') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd676d231-6c, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd676d231-6c, col_values=(('external_ids', {'iface-id': 'd676d231-6c3e-427a-83f1-caab25925cd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:76:0b', 'vm-uuid': 'a23c573c-7547-4739-bf72-ad8fa8fab7ed'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:38 user nova-compute[82522]: INFO os_vif [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=d676d231-6c3e-427a-83f1-caab25925cd6,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd676d231-6c')
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:47:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No VIF found with MAC fa:16:3e:73:76:0b, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:47:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received event network-vif-plugged-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] No waiting events found dispatching network-vif-plugged-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:39 user nova-compute[82522]: WARNING nova.compute.manager [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received unexpected event network-vif-plugged-d676d231-6c3e-427a-83f1-caab25925cd6 for instance with vm_state building and task_state spawning.
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728461.7803512, a23c573c-7547-4739-bf72-ad8fa8fab7ed => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:47:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] VM Resumed (Lifecycle Event)
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:47:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Instance spawned successfully.
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:47:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728461.7831202, a23c573c-7547-4739-bf72-ad8fa8fab7ed => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:47:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] VM Started (Lifecycle Event)
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:41 user nova-compute[82522]: INFO nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Took 5.89 seconds to spawn the instance on the hypervisor.
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received event network-vif-plugged-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] No waiting events found dispatching network-vif-plugged-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:41 user nova-compute[82522]: WARNING nova.compute.manager [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received unexpected event network-vif-plugged-d676d231-6c3e-427a-83f1-caab25925cd6 for instance with vm_state building and task_state spawning.
Apr 17 10:47:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:47:41 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:47:41 user nova-compute[82522]: INFO nova.compute.manager [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Took 6.65 seconds to build instance.
Apr 17 10:47:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.745s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:42 user nova-compute[82522]: INFO nova.compute.manager [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Terminating instance
Apr 17 10:47:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-unplugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] No waiting events found dispatching network-vif-unplugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-unplugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:47:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Instance destroyed successfully.
Apr 17 10:47:42 user nova-compute[82522]: DEBUG nova.objects.instance [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'resources' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486235308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486235308',id=18,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDukjSLeCue+jobK7F8+eqUod8S/SPwFRRjU948hgPTGwDtheEfK10Qt0k7bGB9RgcPDrWEuC4lYGOl33GS6HRjNgrGZR1aDCH1PVL2Qkt1O7P4VtYS1j0HHPoUkaMdtKQ==',key_name='tempest-keypair-1963349943',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6dac880f4294283ae7838bfa0edf5c1',ramdisk_id='',reservation_id='r-nhvcv880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174346715',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174346715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea97828312f45ffa1b7148c375a7f9a',uuid=288bc9dc-1698-4ca9-a670-5e219c04202b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converting VIF {"id": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "address": "fa:16:3e:dc:2c:c6", "network": {"id": "7f2d57e1-037c-452b-ad18-1257d186c845", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-309705412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6dac880f4294283ae7838bfa0edf5c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8541d98c-fc", "ovs_interfaceid": "8541d98c-fcb7-4f1a-904c-97db8145dd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG os_vif [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8541d98c-fc, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:47:42 user nova-compute[82522]: INFO os_vif [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2c:c6,bridge_name='br-int',has_traffic_filtering=True,id=8541d98c-fcb7-4f1a-904c-97db8145dd29,network=Network(7f2d57e1-037c-452b-ad18-1257d186c845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8541d98c-fc')
Apr 17 10:47:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Deleting instance files /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b_del
Apr 17 10:47:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Deletion of /opt/stack/data/nova/instances/288bc9dc-1698-4ca9-a670-5e219c04202b_del complete
Apr 17 10:47:43 user nova-compute[82522]: INFO nova.compute.manager [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 17 10:47:43 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:47:43 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:47:43 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:47:43 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:47:43 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Took 0.85 seconds to deallocate network for instance.
Apr 17 10:47:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:44 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:47:44 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:47:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:44 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Deleted allocations for instance 288bc9dc-1698-4ca9-a670-5e219c04202b
Apr 17 10:47:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] Acquiring lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] Lock "288bc9dc-1698-4ca9-a670-5e219c04202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] No waiting events found dispatching network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:44 user nova-compute[82522]: WARNING nova.compute.manager [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received unexpected event network-vif-plugged-8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance with vm_state deleted and task_state None.
Apr 17 10:47:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Received event network-vif-deleted-8541d98c-fcb7-4f1a-904c-97db8145dd29 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:52 user nova-compute[82522]: INFO nova.compute.manager [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Terminating instance
Apr 17 10:47:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-unplugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] No waiting events found dispatching network-vif-unplugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-unplugged-b7885763-79d0-44c2-bc9d-4a434792584a for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Instance destroyed successfully.
Apr 17 10:47:53 user nova-compute[82522]: DEBUG nova.objects.instance [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lazy-loading 'resources' on Instance uuid 5e03807e-942b-4155-835b-b1c86f5b80f5 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-604329460',display_name='tempest-ServersNegativeTestJSON-server-604329460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-604329460',id=15,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:39:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8b831c3b6c244dda1821583a6b8cd08',ramdisk_id='',reservation_id='r-iki3zlm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-812869679',owner_user_name='tempest-ServersNegativeTestJSON-812869679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:39:12Z,user_data=None,user_id='1e61a5e172c34636b183ef9c84b714d8',uuid=5e03807e-942b-4155-835b-b1c86f5b80f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converting VIF {"id": "b7885763-79d0-44c2-bc9d-4a434792584a", "address": "fa:16:3e:84:2e:b9", "network": {"id": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1633422671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8b831c3b6c244dda1821583a6b8cd08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7885763-79", "ovs_interfaceid": "b7885763-79d0-44c2-bc9d-4a434792584a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=b7885763-79d0-44c2-bc9d-4a434792584a,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7885763-79') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG os_vif [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=b7885763-79d0-44c2-bc9d-4a434792584a,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7885763-79') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7885763-79, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:47:53 user nova-compute[82522]: INFO os_vif [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=b7885763-79d0-44c2-bc9d-4a434792584a,network=Network(d72c00d6-55cf-4a6c-9d41-f5bbe89865d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7885763-79')
Apr 17 10:47:53 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Deleting instance files /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5_del
Apr 17 10:47:53 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Deletion of /opt/stack/data/nova/instances/5e03807e-942b-4155-835b-b1c86f5b80f5_del complete
Apr 17 10:47:53 user nova-compute[82522]: INFO nova.compute.manager [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 17 10:47:53 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:47:54 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Took 1.07 seconds to deallocate network for instance.
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] No waiting events found dispatching network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:54 user nova-compute[82522]: WARNING nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received unexpected event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a for instance with vm_state deleted and task_state None.
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] No waiting events found dispatching network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:54 user nova-compute[82522]: WARNING nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received unexpected event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a for instance with vm_state deleted and task_state None.
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] No waiting events found dispatching network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:54 user nova-compute[82522]: WARNING nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received unexpected event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a for instance with vm_state deleted and task_state None.
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-unplugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] No waiting events found dispatching network-vif-unplugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:54 user nova-compute[82522]: WARNING nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received unexpected event network-vif-unplugged-b7885763-79d0-44c2-bc9d-4a434792584a for instance with vm_state deleted and task_state None.
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Acquiring lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] No waiting events found dispatching network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:47:54 user nova-compute[82522]: WARNING nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received unexpected event network-vif-plugged-b7885763-79d0-44c2-bc9d-4a434792584a for instance with vm_state deleted and task_state None.
Apr 17 10:47:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Received event network-vif-deleted-b7885763-79d0-44c2-bc9d-4a434792584a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:47:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:54 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Deleted allocations for instance 5e03807e-942b-4155-835b-b1c86f5b80f5
Apr 17 10:47:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "5e03807e-942b-4155-835b-b1c86f5b80f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.845s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:47:57 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728462.9482949, 288bc9dc-1698-4ca9-a670-5e219c04202b => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:47:57 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] VM Stopped (Lifecycle Event)
Apr 17 10:47:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d3091381-062a-4d9b-9b1f-83945a247ef9 None None] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:47:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:47:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:08 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728473.1731124, 5e03807e-942b-4155-835b-b1c86f5b80f5 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:48:08 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] VM Stopped (Lifecycle Event)
Apr 17 10:48:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-0311f69d-ff3e-45a5-932f-d8acaedc9c70 None None] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:48:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:48:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:21 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:23 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:24 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:28 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:48:28 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8162MB free_disk=26.317344665527344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e198ad00-927f-45e1-9f14-828d56ce3393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance a23c573c-7547-4739-bf72-ad8fa8fab7ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:48:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:29 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:48:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:48:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:48:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:48:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:30 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Updating instance_info_cache with network_info: [{"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:48:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:48:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:48:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:48:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:48:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:41 user nova-compute[82522]: INFO nova.compute.manager [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Rescuing
Apr 17 10:48:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:48:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquired lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:48:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:48:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Updating instance_info_cache with network_info: [{"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:48:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Releasing lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:48:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:48:42 user nova-compute[82522]: INFO nova.compute.claims [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Claim successful on node user
Apr 17 10:48:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-unplugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-unplugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:48:42 user nova-compute[82522]: WARNING nova.compute.manager [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-unplugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state active and task_state rescuing.
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:48:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Instance destroyed successfully.
Apr 17 10:48:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:48:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Attempting a stable device rescue
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82522) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Instance directory exists: not creating {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 10:48:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Creating image(s)
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "/opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "/opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "/opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'trusted_certs' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "7aa7490ac52546426e90fd39c257c63406716938" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "7aa7490ac52546426e90fd39c257c63406716938" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.policy [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:48:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Creating image(s)
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "/opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "/opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "6b14d485e7094f32e62c9e308213c631849e7603" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "6b14d485e7094f32e62c9e308213c631849e7603" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Successfully created port: 65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938.part --force-share --output=json" returned: 0 in 0.394s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG nova.virt.images [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] a2e12569-124e-4a89-b6b9-db79f2df21d9 was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938.part /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603.part --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG nova.virt.images [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] b9a4fcd5-2f1f-4db6-85be-390733594d1f was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603.part /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938.part /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938.converted" returned: 0 in 0.182s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "7aa7490ac52546426e90fd39c257c63406716938" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.448s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603.part /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603.converted" returned: 0 in 0.280s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "7aa7490ac52546426e90fd39c257c63406716938" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "7aa7490ac52546426e90fd39c257c63406716938" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "6b14d485e7094f32e62c9e308213c631849e7603" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.521s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:48:44 user nova-compute[82522]: WARNING nova.compute.manager [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state active and task_state rescuing.
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938 --force-share --output=json" returned: 0 in 0.174s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938,backing_fmt=raw /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938,backing_fmt=raw /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue" returned: 0 in 0.059s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "7aa7490ac52546426e90fd39c257c63406716938" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'migration_context' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Start _get_guest_xml network_info=[{"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "vif_mac": "fa:16:3e:03:f3:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a2e12569-124e-4a89-b6b9-db79f2df21d9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'c95ba89b-da1a-4d19-9816-ffc2ce7d8593', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGHWqeyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e198ad00-927f-45e1-9f14-828d56ce3393', 'attached_at': '', 'detached_at': '', 'volume_id': '1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 'serial': '1b812f1c-bad0-4b89-b9b8-60c3ddc9669a'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'resources' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603 --force-share --output=json" returned: 0 in 0.165s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "6b14d485e7094f32e62c9e308213c631849e7603" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "6b14d485e7094f32e62c9e308213c631849e7603" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'numa_topology' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:48:44 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:48:44 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'vcpu_model' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGHWqeyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:48:44 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:48:44 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:48:44 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603 --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603,backing_fmt=raw /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0e2433-b457-48e0-949b-075beb808197]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TGHWqeyL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 17 10:48:44 user nova-compute[82522]: node.name = iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:48:44 user nova-compute[82522]: node.tpgt = -1
Apr 17 10:48:44 user nova-compute[82522]: node.startup = automatic
Apr 17 10:48:44 user nova-compute[82522]: node.leading_login = No
Apr 17 10:48:44 user nova-compute[82522]: iface.iscsi_ifacename = default
Apr 17 10:48:44 user nova-compute[82522]: iface.net_ifacename = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.ipaddress = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.prefix_len = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.hwaddress = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.transport_name = tcp
Apr 17 10:48:44 user nova-compute[82522]: iface.initiatorname = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.state = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.vlan_id = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.vlan_priority = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.vlan_state = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.iface_num = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.mtu = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.port = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.bootproto = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.subnet_mask = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.gateway = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.dhcp_alt_client_id_state = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.dhcp_alt_client_id = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.dhcp_dns = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.dhcp_learn_iqn = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.dhcp_req_vendor_id_state = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.dhcp_vendor_id_state = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.dhcp_vendor_id = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.dhcp_slp_da = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.fragmentation = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.gratuitous_arp = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.incoming_forwarding = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.tos_state = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.tos = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.ttl = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.delayed_ack = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.tcp_nagle = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.tcp_wsf_state = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.tcp_wsf = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.tcp_timer_scale = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.tcp_timestamp = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.redirect = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.def_task_mgmt_timeout = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.header_digest = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.data_digest = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.immediate_data = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.initial_r2t = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.data_seq_inorder = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.data_pdu_inorder = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.erl = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.max_receive_data_len = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.first_burst_len = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.max_outstanding_r2t = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.max_burst_len = 0
Apr 17 10:48:44 user nova-compute[82522]: iface.chap_auth = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.bidi_chap = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.strict_login_compliance = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.discovery_auth = <empty>
Apr 17 10:48:44 user nova-compute[82522]: iface.discovery_logout = <empty>
Apr 17 10:48:44 user nova-compute[82522]: node.discovery_address = <empty>
Apr 17 10:48:44 user nova-compute[82522]: node.discovery_port = 0
Apr 17 10:48:44 user nova-compute[82522]: node.discovery_type = static
Apr 17 10:48:44 user nova-compute[82522]: node.session.initial_cmdsn = 0
Apr 17 10:48:44 user nova-compute[82522]: node.session.initial_login_retry_max = 8
Apr 17 10:48:44 user nova-compute[82522]: node.session.xmit_thread_priority = -20
Apr 17 10:48:44 user nova-compute[82522]: node.session.cmds_max = 128
Apr 17 10:48:44 user nova-compute[82522]: node.session.queue_depth = 32
Apr 17 10:48:44 user nova-compute[82522]: node.session.nr_sessions = 1
Apr 17 10:48:44 user nova-compute[82522]: node.session.auth.authmethod = CHAP
Apr 17 10:48:44 user nova-compute[82522]: node.session.auth.username = TGHWqeyL
Apr 17 10:48:44 user nova-compute[82522]: node.session.auth.password = ***
Apr 17 10:48:44 user nova-compute[82522]: node.session.auth.username_in = <empty>
Apr 17 10:48:44 user nova-compute[82522]: node.session.auth.password_in = <empty>
Apr 17 10:48:44 user nova-compute[82522]: node.session.auth.chap_algs = MD5
Apr 17 10:48:44 user nova-compute[82522]: node.session.timeo.replacement_timeout = 120
Apr 17 10:48:44 user nova-compute[82522]: node.session.err_timeo.abort_timeout = 15
Apr 17 10:48:44 user nova-compute[82522]: node.session.err_timeo.lu_reset_timeout = 30
Apr 17 10:48:44 user nova-compute[82522]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 17 10:48:44 user nova-compute[82522]: node.session.err_timeo.host_reset_timeout = 60
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.FastAbort = Yes
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.InitialR2T = No
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.ImmediateData = Yes
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.FirstBurstLength = 262144
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.MaxBurstLength = 16776192
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.DefaultTime2Retain = 0
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.DefaultTime2Wait = 2
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.MaxConnections = 1
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 17 10:48:44 user nova-compute[82522]: node.session.iscsi.ERL = 0
Apr 17 10:48:44 user nova-compute[82522]: node.session.scan = manual
Apr 17 10:48:44 user nova-compute[82522]: node.session.reopen_max = 0
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].address = 172.16.0.220
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].port = 3260
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].startup = manual
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].tcp.window_size = 524288
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].tcp.type_of_service = 0
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].timeo.logout_timeout = 15
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].timeo.login_timeout = 15
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].timeo.auth_timeout = 45
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].timeo.noop_out_interval = 5
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].timeo.noop_out_timeout = 5
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].iscsi.HeaderDigest = None
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].iscsi.DataDigest = None
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].iscsi.IFMarker = No
Apr 17 10:48:44 user nova-compute[82522]: node.conn[0].iscsi.OFMarker = No
Apr 17 10:48:44 user nova-compute[82522]: # END RECORD
Apr 17 10:48:44 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603,backing_fmt=raw /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk 1073741824" returned: 0 in 0.055s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "6b14d485e7094f32e62c9e308213c631849e7603" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b172e2-d01f-4cd0-8f06-5297225fa357]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64cdc30-31b7-4acc-b5da-adf1089e9b38]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGHWqeyL {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGHWqeyL" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b95e8ff-f456-4dc1-876b-aa0d51878319]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TGHWqeyL'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Successfully updated port: 65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88158a4-8ad9-45b8-a1c9-4ec52162bc17]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquired lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603 --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c14284-1c1d-42ef-8241-64b0e5b57266]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing instance network info cache due to event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] Acquiring lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:48:44 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:48:44 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:48:44 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:48:44 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] HCTL ('34', '0', '0', 0) found on session 27 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[328c1441-d8d5-4dd3-8159-5d7594c2b8a0]: (4, ('0 0 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Searching for a device in session 27 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGHWqeyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.287s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] <== connect_volume: return (289ms) {'type': 'block', 'scsi_wwn': '23031663036643530', 'path': '/dev/sdc'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031663036643530', 'path': '/dev/sdc'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1712014270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1712014270',id=25,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:47:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-hhn6szt5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:47:07Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=e198ad00-927f-45e1-9f14-828d56ce3393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "vif_mac": "fa:16:3e:03:f3:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "vif_mac": "fa:16:3e:03:f3:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=8b03fa35-eaab-40ea-a06b-afa4bd410981,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b03fa35-ea') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'pci_devices' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:48:44 user nova-compute[82522]:   <uuid>e198ad00-927f-45e1-9f14-828d56ce3393</uuid>
Apr 17 10:48:44 user nova-compute[82522]:   <name>instance-00000019</name>
Apr 17 10:48:44 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:48:44 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:48:44 user nova-compute[82522]:   <metadata>
Apr 17 10:48:44 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:48:44 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:48:44 user nova-compute[82522]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1712014270</nova:name>
Apr 17 10:48:44 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:48:44</nova:creationTime>
Apr 17 10:48:44 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:48:44 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:48:44 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:48:44 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:48:44 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:48:44 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:48:44 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:48:44 user nova-compute[82522]:       <nova:owner>
Apr 17 10:48:44 user nova-compute[82522]:         <nova:user uuid="d8cb73d24d324903a625e4782270120e">tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member</nova:user>
Apr 17 10:48:44 user nova-compute[82522]:         <nova:project uuid="faab4afa0ddf45578232627c2fac2ff8">tempest-ServerBootFromVolumeStableRescueTest-933538997</nova:project>
Apr 17 10:48:44 user nova-compute[82522]:       </nova:owner>
Apr 17 10:48:44 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:48:44 user nova-compute[82522]:       <nova:ports>
Apr 17 10:48:44 user nova-compute[82522]:         <nova:port uuid="8b03fa35-eaab-40ea-a06b-afa4bd410981">
Apr 17 10:48:44 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 17 10:48:44 user nova-compute[82522]:         </nova:port>
Apr 17 10:48:44 user nova-compute[82522]:       </nova:ports>
Apr 17 10:48:44 user nova-compute[82522]:     </nova:instance>
Apr 17 10:48:44 user nova-compute[82522]:   </metadata>
Apr 17 10:48:44 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:48:44 user nova-compute[82522]:     <system>
Apr 17 10:48:44 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:48:44 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:48:44 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:48:44 user nova-compute[82522]:       <entry name="serial">e198ad00-927f-45e1-9f14-828d56ce3393</entry>
Apr 17 10:48:44 user nova-compute[82522]:       <entry name="uuid">e198ad00-927f-45e1-9f14-828d56ce3393</entry>
Apr 17 10:48:44 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:48:44 user nova-compute[82522]:     </system>
Apr 17 10:48:44 user nova-compute[82522]:   </sysinfo>
Apr 17 10:48:44 user nova-compute[82522]:   <os>
Apr 17 10:48:44 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:48:44 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:48:44 user nova-compute[82522]:   </os>
Apr 17 10:48:44 user nova-compute[82522]:   <features>
Apr 17 10:48:44 user nova-compute[82522]:     <acpi/>
Apr 17 10:48:44 user nova-compute[82522]:     <apic/>
Apr 17 10:48:44 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:48:44 user nova-compute[82522]:   </features>
Apr 17 10:48:44 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:48:44 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:48:44 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:48:44 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:48:44 user nova-compute[82522]:   </clock>
Apr 17 10:48:44 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:48:44 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:48:44 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:48:44 user nova-compute[82522]:   </cpu>
Apr 17 10:48:44 user nova-compute[82522]:   <devices>
Apr 17 10:48:44 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:48:44 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:48:44 user nova-compute[82522]:       <source dev="/dev/sdc"/>
Apr 17 10:48:44 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:48:44 user nova-compute[82522]:       <serial>1b812f1c-bad0-4b89-b9b8-60c3ddc9669a</serial>
Apr 17 10:48:44 user nova-compute[82522]:     </disk>
Apr 17 10:48:44 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:48:44 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:48:44 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue"/>
Apr 17 10:48:44 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:48:44 user nova-compute[82522]:       <boot order="1"/>
Apr 17 10:48:44 user nova-compute[82522]:     </disk>
Apr 17 10:48:44 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:48:44 user nova-compute[82522]:       <mac address="fa:16:3e:03:f3:95"/>
Apr 17 10:48:44 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:48:44 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:48:44 user nova-compute[82522]:       <target dev="tap8b03fa35-ea"/>
Apr 17 10:48:44 user nova-compute[82522]:     </interface>
Apr 17 10:48:44 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:48:44 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/console.log" append="off"/>
Apr 17 10:48:44 user nova-compute[82522]:     </serial>
Apr 17 10:48:44 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:48:44 user nova-compute[82522]:     <video>
Apr 17 10:48:44 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:48:44 user nova-compute[82522]:     </video>
Apr 17 10:48:44 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:48:44 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:48:44 user nova-compute[82522]:     </rng>
Apr 17 10:48:44 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:48:44 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:48:44 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:48:44 user nova-compute[82522]:     </memballoon>
Apr 17 10:48:44 user nova-compute[82522]:   </devices>
Apr 17 10:48:44 user nova-compute[82522]: </domain>
Apr 17 10:48:44 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Cannot resize image /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.objects.instance [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'migration_context' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:48:44 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Instance destroyed successfully.
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Ensure instance console log exists: /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:48:44 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] No VIF found with MAC fa:16:3e:03:f3:95, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.network.neutron [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updating instance_info_cache with network_info: [{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Releasing lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Instance network_info: |[{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] Acquired lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.network.neutron [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Start _get_guest_xml network_info=[{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:48:39Z,direct_url=<?>,disk_format='qcow2',id=b9a4fcd5-2f1f-4db6-85be-390733594d1f,min_disk=0,min_ram=0,name='tempest-scenario-img--532613668',owner='455ea6870abe450ba413ffabf4d4097e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:48:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': 'b9a4fcd5-2f1f-4db6-85be-390733594d1f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:48:45 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:48:45 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:48:39Z,direct_url=<?>,disk_format='qcow2',id=b9a4fcd5-2f1f-4db6-85be-390733594d1f,min_disk=0,min_ram=0,name='tempest-scenario-img--532613668',owner='455ea6870abe450ba413ffabf4d4097e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:48:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1426878970',display_name='tempest-TestMinimumBasicScenario-server-1426878970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1426878970',id=27,image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORcRCSidzCtZERfUBnTDAnNSPELy1dgk6b9Q8gc8T4PAqATO1Uji336+kxtRXvHft6CLIvqnAvnpFG9PPMqkQyHfLPSq8yFarfYxhKHvEuKs5HLwpgj3LQxqJVyr1Uk0w==',key_name='tempest-TestMinimumBasicScenario-893387962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='455ea6870abe450ba413ffabf4d4097e',ramdisk_id='',reservation_id='r-crcqn0qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1309632250',owner_user_name='tempest-TestMinimumBasicScenario-1309632250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:48:43Z,user_data=None,user_id='df693038f49145b9854ae18d246dde2f',uuid=3fd89020-5492-4e40-a911-63f9b1b43315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converting VIF {"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.objects.instance [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:48:45 user nova-compute[82522]:   <uuid>3fd89020-5492-4e40-a911-63f9b1b43315</uuid>
Apr 17 10:48:45 user nova-compute[82522]:   <name>instance-0000001b</name>
Apr 17 10:48:45 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:48:45 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:48:45 user nova-compute[82522]:   <metadata>
Apr 17 10:48:45 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:48:45 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:48:45 user nova-compute[82522]:       <nova:name>tempest-TestMinimumBasicScenario-server-1426878970</nova:name>
Apr 17 10:48:45 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:48:45</nova:creationTime>
Apr 17 10:48:45 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:48:45 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:48:45 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:48:45 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:48:45 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:48:45 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:48:45 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:48:45 user nova-compute[82522]:       <nova:owner>
Apr 17 10:48:45 user nova-compute[82522]:         <nova:user uuid="df693038f49145b9854ae18d246dde2f">tempest-TestMinimumBasicScenario-1309632250-project-member</nova:user>
Apr 17 10:48:45 user nova-compute[82522]:         <nova:project uuid="455ea6870abe450ba413ffabf4d4097e">tempest-TestMinimumBasicScenario-1309632250</nova:project>
Apr 17 10:48:45 user nova-compute[82522]:       </nova:owner>
Apr 17 10:48:45 user nova-compute[82522]:       <nova:root type="image" uuid="b9a4fcd5-2f1f-4db6-85be-390733594d1f"/>
Apr 17 10:48:45 user nova-compute[82522]:       <nova:ports>
Apr 17 10:48:45 user nova-compute[82522]:         <nova:port uuid="65f23819-ccfb-4eb0-adc1-3f9895ed9c39">
Apr 17 10:48:45 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:48:45 user nova-compute[82522]:         </nova:port>
Apr 17 10:48:45 user nova-compute[82522]:       </nova:ports>
Apr 17 10:48:45 user nova-compute[82522]:     </nova:instance>
Apr 17 10:48:45 user nova-compute[82522]:   </metadata>
Apr 17 10:48:45 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:48:45 user nova-compute[82522]:     <system>
Apr 17 10:48:45 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:48:45 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:48:45 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:48:45 user nova-compute[82522]:       <entry name="serial">3fd89020-5492-4e40-a911-63f9b1b43315</entry>
Apr 17 10:48:45 user nova-compute[82522]:       <entry name="uuid">3fd89020-5492-4e40-a911-63f9b1b43315</entry>
Apr 17 10:48:45 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:48:45 user nova-compute[82522]:     </system>
Apr 17 10:48:45 user nova-compute[82522]:   </sysinfo>
Apr 17 10:48:45 user nova-compute[82522]:   <os>
Apr 17 10:48:45 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:48:45 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:48:45 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:48:45 user nova-compute[82522]:   </os>
Apr 17 10:48:45 user nova-compute[82522]:   <features>
Apr 17 10:48:45 user nova-compute[82522]:     <acpi/>
Apr 17 10:48:45 user nova-compute[82522]:     <apic/>
Apr 17 10:48:45 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:48:45 user nova-compute[82522]:   </features>
Apr 17 10:48:45 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:48:45 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:48:45 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:48:45 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:48:45 user nova-compute[82522]:   </clock>
Apr 17 10:48:45 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:48:45 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:48:45 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:48:45 user nova-compute[82522]:   </cpu>
Apr 17 10:48:45 user nova-compute[82522]:   <devices>
Apr 17 10:48:45 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:48:45 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:48:45 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk"/>
Apr 17 10:48:45 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:48:45 user nova-compute[82522]:     </disk>
Apr 17 10:48:45 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:48:45 user nova-compute[82522]:       <mac address="fa:16:3e:08:b5:98"/>
Apr 17 10:48:45 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:48:45 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:48:45 user nova-compute[82522]:       <target dev="tap65f23819-cc"/>
Apr 17 10:48:45 user nova-compute[82522]:     </interface>
Apr 17 10:48:45 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:48:45 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/console.log" append="off"/>
Apr 17 10:48:45 user nova-compute[82522]:     </serial>
Apr 17 10:48:45 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:48:45 user nova-compute[82522]:     <video>
Apr 17 10:48:45 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:48:45 user nova-compute[82522]:     </video>
Apr 17 10:48:45 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:48:45 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:48:45 user nova-compute[82522]:     </rng>
Apr 17 10:48:45 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:48:45 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:48:45 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:48:45 user nova-compute[82522]:     </memballoon>
Apr 17 10:48:45 user nova-compute[82522]:   </devices>
Apr 17 10:48:45 user nova-compute[82522]: </domain>
Apr 17 10:48:45 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1426878970',display_name='tempest-TestMinimumBasicScenario-server-1426878970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1426878970',id=27,image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORcRCSidzCtZERfUBnTDAnNSPELy1dgk6b9Q8gc8T4PAqATO1Uji336+kxtRXvHft6CLIvqnAvnpFG9PPMqkQyHfLPSq8yFarfYxhKHvEuKs5HLwpgj3LQxqJVyr1Uk0w==',key_name='tempest-TestMinimumBasicScenario-893387962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='455ea6870abe450ba413ffabf4d4097e',ramdisk_id='',reservation_id='r-crcqn0qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1309632250',owner_user_name='tempest-TestMinimumBasicScenario-1309632250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:48:43Z,user_data=None,user_id='df693038f49145b9854ae18d246dde2f',uuid=3fd89020-5492-4e40-a911-63f9b1b43315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converting VIF {"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG os_vif [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65f23819-cc, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65f23819-cc, col_values=(('external_ids', {'iface-id': '65f23819-ccfb-4eb0-adc1-3f9895ed9c39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:b5:98', 'vm-uuid': '3fd89020-5492-4e40-a911-63f9b1b43315'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:45 user nova-compute[82522]: INFO os_vif [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc')
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No VIF found with MAC fa:16:3e:08:b5:98, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:48:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updated VIF entry in instance network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG nova.network.neutron [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updating instance_info_cache with network_info: [{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] Releasing lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:48:46 user nova-compute[82522]: WARNING nova.compute.manager [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state active and task_state rescuing.
Apr 17 10:48:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:48:49 user nova-compute[82522]: WARNING nova.compute.manager [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state active and task_state rescuing.
Apr 17 10:48:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] No waiting events found dispatching network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:48:49 user nova-compute[82522]: WARNING nova.compute.manager [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received unexpected event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance with vm_state building and task_state spawning.
Apr 17 10:48:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for e198ad00-927f-45e1-9f14-828d56ce3393 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728530.8738496, e198ad00-927f-45e1-9f14-828d56ce3393 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:48:50 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] VM Resumed (Lifecycle Event)
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:48:50 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728530.8755317, e198ad00-927f-45e1-9f14-828d56ce3393 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:48:50 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] VM Started (Lifecycle Event)
Apr 17 10:48:50 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Instance spawned successfully.
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:48:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728530.9413466, 3fd89020-5492-4e40-a911-63f9b1b43315 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:48:51 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] VM Resumed (Lifecycle Event)
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:48:51 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728530.9432611, 3fd89020-5492-4e40-a911-63f9b1b43315 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:48:51 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] VM Started (Lifecycle Event)
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] No waiting events found dispatching network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:48:51 user nova-compute[82522]: WARNING nova.compute.manager [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received unexpected event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance with vm_state building and task_state spawning.
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:48:51 user nova-compute[82522]: INFO nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Took 8.45 seconds to spawn the instance on the hypervisor.
Apr 17 10:48:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:48:51 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:48:51 user nova-compute[82522]: INFO nova.compute.manager [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Took 9.27 seconds to build instance.
Apr 17 10:48:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.376s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:48:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:48:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:11 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'flavor' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:12 user nova-compute[82522]: INFO nova.compute.manager [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attaching volume ed14165c-7141-4cb0-816c-aa875719d300 to /dev/vdb
Apr 17 10:49:12 user nova-compute[82522]: DEBUG os_brick.utils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb81376-9e43-4f87-a332-6456d10842ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b95f42c-8c1c-42be-8ca7-c5a6cb9095e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9698f0a3-6b6d-40c0-81e5-c208d952a208]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33e50f9-7e30-46e7-adf7-77396542f415]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:49:12 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:49:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4418efe0-36dc-4360-95d2-2cd1a8db23bd]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG os_brick.utils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:49:12 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating existing volume attachment record: 40877d2b-b0b5-460d-9c0d-fcc193885286 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:49:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHKJYASM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:49:18 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:49:18 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:49:18 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[007bfa34-8e1f-47ab-aa05-7912124c88da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:49:18 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f987842-813a-4ad3-a975-544a80de0fa8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300] added
Apr 17 10:49:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d78279-ee20-4085-b6de-edf4a26350d2]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b889d7ee-c0e7-442e-a13f-67238e6de89b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHKJYASM {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHKJYASM" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c4f2c1-f105-4d84-ba46-335e87f921c1]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nHKJYASM'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b10946-34ad-498a-9e8f-169eb5179ed6]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c326861-2273-40fd-91fb-f6044a0f6dcf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:18 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:18 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4532082c-cf34-4876-901b-5b9b4b243a6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260]
Apr 17 10:49:18 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260] successful.
Apr 17 10:49:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4b46d4-2956-48b7-a725-e55006829116]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca25871-1ab2-4735-9044-e89cdec078d6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:18 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:18 user nova-compute[82522]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:18 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:18 user nova-compute[82522]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c49779-01d6-4df7-8a50-576a4cbb8e63]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:49:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHKJYASM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:49:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:49:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23464643736653337', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:49:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464643736653337', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:49:19 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'flavor' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:49:19 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:49:19 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:49:19 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:49:19 user nova-compute[82522]:   <serial>ed14165c-7141-4cb0-816c-aa875719d300</serial>
Apr 17 10:49:19 user nova-compute[82522]: </disk>
Apr 17 10:49:19 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:49:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:49:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:49:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No VIF found with MAC fa:16:3e:d3:62:81, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:49:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.903s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:21 user nova-compute[82522]: INFO nova.compute.manager [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Rebuilding instance
Apr 17 10:49:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'pci_requests' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'resources' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'migration_context' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82522) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:49:22 user nova-compute[82522]: WARNING nova.compute.manager [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state active and task_state rebuilding.
Apr 17 10:49:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance destroyed successfully.
Apr 17 10:49:22 user nova-compute[82522]: INFO nova.compute.manager [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Detaching volume ed14165c-7141-4cb0-816c-aa875719d300
Apr 17 10:49:22 user nova-compute[82522]: INFO nova.virt.block_device [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attempting to driver detach volume ed14165c-7141-4cb0-816c-aa875719d300 from mountpoint /dev/vdb
Apr 17 10:49:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Attempting to detach device vdb from instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:49:22 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:49:22 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:49:22 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:49:22 user nova-compute[82522]:   <serial>ed14165c-7141-4cb0-816c-aa875719d300</serial>
Apr 17 10:49:22 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:49:22 user nova-compute[82522]: </disk>
Apr 17 10:49:22 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:49:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully detached device vdb from instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 from the persistent domain config.
Apr 17 10:49:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHKJYASM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:49:22 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[43de293d-311c-4c4e-9352-c3080c6507a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:49:22 user nova-compute[82522]: No targets found.
Apr 17 10:49:22 user nova-compute[82522]: iSNS:
Apr 17 10:49:22 user nova-compute[82522]: No targets found.
Apr 17 10:49:22 user nova-compute[82522]: STATIC:
Apr 17 10:49:22 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:49:22 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:49:22 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:49:22 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:49:22 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:49:22 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:49:22 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300
Apr 17 10:49:22 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:49:22 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:49:22 user nova-compute[82522]: FIRMWARE:
Apr 17 10:49:22 user nova-compute[82522]: No targets found.
Apr 17 10:49:22 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:49:22 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:49:22 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a8a754-0951-435a-9e5d-97f3d8515bbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[def1ba6a-469b-42db-93c5-ece9400da007]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:22 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:22 user nova-compute[82522]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:22 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:22 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:22 user nova-compute[82522]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:22 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2a47081f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300'): ({'sdd'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Removing single pathed devices sdd {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7fb4c5-5cef-4651-8e6d-6f11d22cfa48]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dff083b-1491-4289-8f53-a4d9399baee2]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flushing IO for device /dev/sdd {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73775ae-9ab8-4198-9117-45d714f8f0b3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5267a75b-ec1d-48ae-a4b5-ca615739922a]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:49:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f100c7f-20f9-4cde-b157-ca9cff538272]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed90c84-a8b1-477a-8c1c-bc7c3581bcad]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260]
Apr 17 10:49:23 user nova-compute[82522]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260] successful.
Apr 17 10:49:23 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2212b3-b948-4713-adb6-c1fefd554b84]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== disconnect_volume: return (315ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:49:23 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance destroyed successfully.
Apr 17 10:49:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:49:23 user nova-compute[82522]: DEBUG os_vif [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67386c8f-91, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:24 user nova-compute[82522]: INFO os_vif [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91')
Apr 17 10:49:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHKJYASM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:49:24 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fe6970-b929-4bf3-bd1d-2cc09810c39d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:49:24 user nova-compute[82522]: No targets found.
Apr 17 10:49:24 user nova-compute[82522]: iSNS:
Apr 17 10:49:24 user nova-compute[82522]: No targets found.
Apr 17 10:49:24 user nova-compute[82522]: STATIC:
Apr 17 10:49:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:49:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:49:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:49:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:49:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:49:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:49:24 user nova-compute[82522]: FIRMWARE:
Apr 17 10:49:24 user nova-compute[82522]: No targets found.
Apr 17 10:49:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:49:24 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:49:24 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[78385a9b-f7c3-4e92-a247-e612b822edcc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[089b0aab-41d3-4260-979f-92fb38ccfa41]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:24 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:24 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7cd84c0>, {}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Disconnecting from: [] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== disconnect_volume: return (74ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:49:24 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Deleting instance files /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38_del
Apr 17 10:49:24 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Deletion of /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38_del complete
Apr 17 10:49:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:49:24 user nova-compute[82522]: WARNING nova.compute.manager [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state active and task_state rebuilding.
Apr 17 10:49:24 user nova-compute[82522]: INFO nova.virt.block_device [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Booting with volume ed14165c-7141-4cb0-816c-aa875719d300 at /dev/vdb
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.utils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c88b050-b30f-463f-a2ac-4eedd9663ab9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4a23b5-a648-406d-9fbb-9be7a8693ec9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a8322c-90f0-4d18-a13f-03276b8d6fa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4b7467-0e43-4f95-bfd5-4a91471567fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:49:24 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:49:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad077332-e364-4fb1-b4a3-88cc21fcdf7f]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG os_brick.utils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:49:24 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating existing volume attachment record: e895a8b8-78f8-4a0e-a0b8-d9dd986f1c24 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:49:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:49:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received event network-changed-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Refreshing instance network info cache due to event network-changed-d676d231-6c3e-427a-83f1-caab25925cd6. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] Acquiring lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] Acquired lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG nova.network.neutron [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Refreshing network info cache for port d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG nova.objects.instance [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'flavor' on Instance uuid a23c573c-7547-4739-bf72-ad8fa8fab7ed {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:28 user nova-compute[82522]: INFO nova.compute.manager [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Attaching volume 88e4223b-2a7a-4d14-aad9-ab3348ebe460 to /dev/vdb
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG os_brick.utils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093139e-cad9-41ae-9400-8c4596837a23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[120ec6da-3b21-4cb2-a449-6c292c9ae1d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68bec7-db0e-487f-b146-1afd5fc34631]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8de89c-16a4-4c41-b1c4-62b9856f4357]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Updated VIF entry in instance network info cache for port d676d231-6c3e-427a-83f1-caab25925cd6. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Updating instance_info_cache with network_info: [{"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:49:29 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:49:29 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b51d09-9fba-4fc4-a8bb-ab1b00f25f5a]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG os_brick.utils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] <== get_connector_properties: return (230ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Updating existing volume attachment record: cfed25e1-a592-461f-919a-47bac129be08 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] Releasing lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:49:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:49:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8060MB free_disk=26.184539794921875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e198ad00-927f-45e1-9f14-828d56ce3393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance a23c573c-7547-4739-bf72-ad8fa8fab7ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3fd89020-5492-4e40-a911-63f9b1b43315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:49:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:49:30 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:49:30 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:49:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:49:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:49:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:49:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:49:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:49:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updating instance_info_cache with network_info: [{"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:49:32 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Creating image(s)
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.171s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk 1073741824" returned: 0 in 0.065s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Cannot resize image /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Ensure instance console log exists: /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Start _get_guest_xml network_info=[{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'e895a8b8-78f8-4a0e-a0b8-d9dd986f1c24', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHKJYASM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed14165c-7141-4cb0-816c-aa875719d300', 'serial': 'ed14165c-7141-4cb0-816c-aa875719d300'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:49:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 17 10:49:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHKJYASM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:49:33 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:49:33 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:49:33 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faebf94-187f-4182-83bc-ad7164a4dbc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:49:33 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32efbab-8426-4cea-b0d0-2399d8c59bc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300] added
Apr 17 10:49:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2522a994-7158-4c05-825e-13afb9a90cfd]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.075s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77c52a0-3bc3-4daf-a9f8-166c8401569c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHKJYASM {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHKJYASM" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[838c283f-e053-440d-98af-4c5859bcf578]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nHKJYASM'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[03df0dd7-2f59-4017-bfb1-a51a2798978f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2de337-f630-429b-9fe5-2aea8ddc97b1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:33 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:33 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea23cc-35e9-451f-8f45-809cfabed305]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260]
Apr 17 10:49:33 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260] successful.
Apr 17 10:49:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e823cf16-ca22-4ee2-b17c-2e71324b616c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0529de4-ed1a-4774-be9f-8a98c327bd79]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:33 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:33 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:33 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:33 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:33 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c615adb-d18f-4e1d-a6cc-bfac4426d601]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:49:33 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHKJYASM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbURCrkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:49:34 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23464643736653337', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464643736653337', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.571s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:49:34 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:49:34 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a9610c-a6c1-476e-8ff2-03fbdddca670]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:49:34 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:49:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:49:34 user nova-compute[82522]:   <uuid>2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</uuid>
Apr 17 10:49:34 user nova-compute[82522]:   <name>instance-00000018</name>
Apr 17 10:49:34 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:49:34 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:49:34 user nova-compute[82522]:   <metadata>
Apr 17 10:49:34 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:49:34 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:49:34 user nova-compute[82522]:       <nova:name>tempest-ServerActionsTestJSON-server-1036404855</nova:name>
Apr 17 10:49:34 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:49:33</nova:creationTime>
Apr 17 10:49:34 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:49:34 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:49:34 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:49:34 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:49:34 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:49:34 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:49:34 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:49:34 user nova-compute[82522]:       <nova:owner>
Apr 17 10:49:34 user nova-compute[82522]:         <nova:user uuid="a7e218d771db49e88d13d3b088f3d88a">tempest-ServerActionsTestJSON-2107442540-project-member</nova:user>
Apr 17 10:49:34 user nova-compute[82522]:         <nova:project uuid="cc1b39ff9581474b87c58164e5cafa00">tempest-ServerActionsTestJSON-2107442540</nova:project>
Apr 17 10:49:34 user nova-compute[82522]:       </nova:owner>
Apr 17 10:49:34 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:49:34 user nova-compute[82522]:       <nova:ports>
Apr 17 10:49:34 user nova-compute[82522]:         <nova:port uuid="67386c8f-911d-4398-b449-42af25f6afe3">
Apr 17 10:49:34 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:49:34 user nova-compute[82522]:         </nova:port>
Apr 17 10:49:34 user nova-compute[82522]:       </nova:ports>
Apr 17 10:49:34 user nova-compute[82522]:     </nova:instance>
Apr 17 10:49:34 user nova-compute[82522]:   </metadata>
Apr 17 10:49:34 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:49:34 user nova-compute[82522]:     <system>
Apr 17 10:49:34 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:49:34 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:49:34 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:49:34 user nova-compute[82522]:       <entry name="serial">2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</entry>
Apr 17 10:49:34 user nova-compute[82522]:       <entry name="uuid">2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</entry>
Apr 17 10:49:34 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:49:34 user nova-compute[82522]:     </system>
Apr 17 10:49:34 user nova-compute[82522]:   </sysinfo>
Apr 17 10:49:34 user nova-compute[82522]:   <os>
Apr 17 10:49:34 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:49:34 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:49:34 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:49:34 user nova-compute[82522]:   </os>
Apr 17 10:49:34 user nova-compute[82522]:   <features>
Apr 17 10:49:34 user nova-compute[82522]:     <acpi/>
Apr 17 10:49:34 user nova-compute[82522]:     <apic/>
Apr 17 10:49:34 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:49:34 user nova-compute[82522]:   </features>
Apr 17 10:49:34 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:49:34 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:49:34 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:49:34 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:49:34 user nova-compute[82522]:   </clock>
Apr 17 10:49:34 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:49:34 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:49:34 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:49:34 user nova-compute[82522]:   </cpu>
Apr 17 10:49:34 user nova-compute[82522]:   <devices>
Apr 17 10:49:34 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:49:34 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:49:34 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk"/>
Apr 17 10:49:34 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:49:34 user nova-compute[82522]:     </disk>
Apr 17 10:49:34 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:49:34 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:49:34 user nova-compute[82522]:       <source dev="/dev/sdd"/>
Apr 17 10:49:34 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:49:34 user nova-compute[82522]:       <serial>ed14165c-7141-4cb0-816c-aa875719d300</serial>
Apr 17 10:49:34 user nova-compute[82522]:     </disk>
Apr 17 10:49:34 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:49:34 user nova-compute[82522]:       <mac address="fa:16:3e:d3:62:81"/>
Apr 17 10:49:34 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:49:34 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:49:34 user nova-compute[82522]:       <target dev="tap67386c8f-91"/>
Apr 17 10:49:34 user nova-compute[82522]:     </interface>
Apr 17 10:49:34 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:49:34 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/console.log" append="off"/>
Apr 17 10:49:34 user nova-compute[82522]:     </serial>
Apr 17 10:49:34 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:49:34 user nova-compute[82522]:     <video>
Apr 17 10:49:34 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:49:34 user nova-compute[82522]:     </video>
Apr 17 10:49:34 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:49:34 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:49:34 user nova-compute[82522]:     </rng>
Apr 17 10:49:34 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:49:34 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:49:34 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:49:34 user nova-compute[82522]:     </memballoon>
Apr 17 10:49:34 user nova-compute[82522]:   </devices>
Apr 17 10:49:34 user nova-compute[82522]: </domain>
Apr 17 10:49:34 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:49:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_vif [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67386c8f-91, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67386c8f-91, col_values=(('external_ids', {'iface-id': '67386c8f-911d-4398-b449-42af25f6afe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:62:81', 'vm-uuid': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b5bd51-7781-496e-b82c-e57bbabcf787]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460] added
Apr 17 10:49:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:34 user nova-compute[82522]: INFO os_vif [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91')
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72a9a97-f39c-4f20-899e-5e974444c036]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc789e1-84f5-4570-bc75-7c6468d9ad46]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbURCrkf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No VIF found with MAC fa:16:3e:d3:62:81, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbURCrkf" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31b5ec7-bfbd-47cd-b1a2-f6e17264dbe3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TbURCrkf'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ba3ad5-5e18-4c38-a99f-38968d0f6de6]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[51185115-04d6-4fb9-a418-42290f95609e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d757b75-c823-4027-9a76-734f904bd405]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460, portal: 172.16.0.220,3260]
Apr 17 10:49:34 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460, portal: 172.16.0.220,3260] successful.
Apr 17 10:49:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f58c3ec-6085-4c07-96f2-3089a6c9f39f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbf83e7-b3eb-4224-adab-daa9aca9a18b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 (non-flash)
Apr 17 10:49:34 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[644fbfca-ae2a-4c66-868d-0a8f9ea23b79]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:49:34 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbURCrkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:49:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:49:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] <== connect_volume: return (1936ms) {'type': 'block', 'scsi_wwn': '23762303665633536', 'path': '/dev/sde'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:49:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762303665633536', 'path': '/dev/sde'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:49:35 user nova-compute[82522]: DEBUG nova.objects.instance [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'flavor' on Instance uuid a23c573c-7547-4739-bf72-ad8fa8fab7ed {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:49:36 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:49:36 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:49:36 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:49:36 user nova-compute[82522]:   <serial>88e4223b-2a7a-4d14-aad9-ab3348ebe460</serial>
Apr 17 10:49:36 user nova-compute[82522]: </disk>
Apr 17 10:49:36 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:49:36 user nova-compute[82522]: WARNING nova.compute.manager [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state active and task_state rebuild_spawning.
Apr 17 10:49:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] No VIF found with MAC fa:16:3e:73:76:0b, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.961s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:37 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728562.5564249, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:49:37 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Stopped (Lifecycle Event)
Apr 17 10:49:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-5591c9d7-b05a-4441-9ebe-f9b919f23e9b None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:38 user nova-compute[82522]: INFO nova.compute.manager [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Detaching volume 88e4223b-2a7a-4d14-aad9-ab3348ebe460
Apr 17 10:49:38 user nova-compute[82522]: INFO nova.virt.block_device [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Attempting to driver detach volume 88e4223b-2a7a-4d14-aad9-ab3348ebe460 from mountpoint /dev/vdb
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Attempting to detach device vdb from instance a23c573c-7547-4739-bf72-ad8fa8fab7ed from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:49:38 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:49:38 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:49:38 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:49:38 user nova-compute[82522]:   <serial>88e4223b-2a7a-4d14-aad9-ab3348ebe460</serial>
Apr 17 10:49:38 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:49:38 user nova-compute[82522]: </disk>
Apr 17 10:49:38 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:49:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Successfully detached device vdb from instance a23c573c-7547-4739-bf72-ad8fa8fab7ed from the persistent domain config.
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a23c573c-7547-4739-bf72-ad8fa8fab7ed from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:49:38 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:49:38 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:49:38 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:49:38 user nova-compute[82522]:   <serial>88e4223b-2a7a-4d14-aad9-ab3348ebe460</serial>
Apr 17 10:49:38 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:49:38 user nova-compute[82522]: </disk>
Apr 17 10:49:38 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:49:38 user nova-compute[82522]: WARNING nova.compute.manager [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state active and task_state rebuild_spawning.
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728578.5999146, a23c573c-7547-4739-bf72-ad8fa8fab7ed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:49:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Successfully detached device vdb from instance a23c573c-7547-4739-bf72-ad8fa8fab7ed from the live domain config.
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbURCrkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:49:38 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[045d7aec-0c76-412f-af25-f3471a739f5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:49:38 user nova-compute[82522]: No targets found.
Apr 17 10:49:38 user nova-compute[82522]: iSNS:
Apr 17 10:49:38 user nova-compute[82522]: No targets found.
Apr 17 10:49:38 user nova-compute[82522]: STATIC:
Apr 17 10:49:38 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:49:38 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:49:38 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:49:38 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:49:38 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:49:38 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:49:38 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460
Apr 17 10:49:38 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:49:38 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:49:38 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300
Apr 17 10:49:38 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:49:38 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:49:38 user nova-compute[82522]: FIRMWARE:
Apr 17 10:49:38 user nova-compute[82522]: No targets found.
Apr 17 10:49:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:49:38 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:49:38 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf6187c-f6bf-4179-aab1-564837423434]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728578.67549, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:49:38 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Resumed (Lifecycle Event)
Apr 17 10:49:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance spawned successfully.
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd7caf-2e5e-45ef-bff1-ebfe30dfbd26]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:38 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:38 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:38 user nova-compute[82522]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 (non-flash)
Apr 17 10:49:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:49:38 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:49:38 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:49:38 user nova-compute[82522]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 (non-flash)
Apr 17 10:49:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2843b2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460'): ({'sde'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Removing single pathed devices sde {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728578.6757195, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:49:38 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Started (Lifecycle Event)
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d555e88-44a3-446c-a7bd-43667632f4ef]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea2c5eb-b741-40a0-a624-b2a1e60c3422]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flushing IO for device /dev/sde {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e37eb11-8ee5-4f6c-bd07-5443022f89e7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bbbd67-4368-4148-9053-d15cf98b4740]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8acd50-6697-4713-bdff-61036549c34d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.objects.instance [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82522) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfa6f60-a669-4cf6-bca7-27e19601f729]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460, portal: 172.16.0.220,3260]
Apr 17 10:49:38 user nova-compute[82522]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460, portal: 172.16.0.220,3260] successful.
Apr 17 10:49:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4223b-2a7a-4d14-aad9-ab3348ebe460 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8813fd-10ce-4f36-a107-d75604416b21]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] <== disconnect_volume: return (384ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:49:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:49:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:39 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'flavor' on Instance uuid a23c573c-7547-4739-bf72-ad8fa8fab7ed {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.946s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:46 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:49:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:46 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:49:46 user nova-compute[82522]: INFO nova.compute.claims [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Claim successful on node user
Apr 17 10:49:47 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:49:47 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:49:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG nova.policy [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30ad2b6b478547e78e2cf273ef0390ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652f9a7f20954e23b143e349c538f418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:49:47 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Creating image(s)
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "/opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "/opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.179s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.183s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk 1073741824" returned: 0 in 0.079s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.171s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Cannot resize image /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'migration_context' on Instance uuid 7fabb8d9-4062-418a-b890-48c4b45cf9cf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Ensure instance console log exists: /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:48 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Successfully created port: 63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Successfully updated port: 63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "refresh_cache-7fabb8d9-4062-418a-b890-48c4b45cf9cf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquired lock "refresh_cache-7fabb8d9-4062-418a-b890-48c4b45cf9cf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received event network-changed-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Refreshing instance network info cache due to event network-changed-63e11d1a-088d-4c09-b938-48d54ba791fd. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] Acquiring lock "refresh_cache-7fabb8d9-4062-418a-b890-48c4b45cf9cf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Updating instance_info_cache with network_info: [{"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Releasing lock "refresh_cache-7fabb8d9-4062-418a-b890-48c4b45cf9cf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Instance network_info: |[{"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] Acquired lock "refresh_cache-7fabb8d9-4062-418a-b890-48c4b45cf9cf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG nova.network.neutron [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Refreshing network info cache for port 63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:49:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Start _get_guest_xml network_info=[{"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:49:50 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:49:50 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1095013513',display_name='tempest-VolumesSnapshotTestJSON-instance-1095013513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1095013513',id=28,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='652f9a7f20954e23b143e349c538f418',ramdisk_id='',reservation_id='r-ugvhb85g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1076174579',owner_user_name='tempest-VolumesSnapshotTestJSON-1076174579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:49:47Z,user_data=None,user_id='30ad2b6b478547e78e2cf273ef0390ed',uuid=7fabb8d9-4062-418a-b890-48c4b45cf9cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converting VIF {"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:4f:13,bridge_name='br-int',has_traffic_filtering=True,id=63e11d1a-088d-4c09-b938-48d54ba791fd,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e11d1a-08') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fabb8d9-4062-418a-b890-48c4b45cf9cf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:49:50 user nova-compute[82522]:   <uuid>7fabb8d9-4062-418a-b890-48c4b45cf9cf</uuid>
Apr 17 10:49:50 user nova-compute[82522]:   <name>instance-0000001c</name>
Apr 17 10:49:50 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:49:50 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:49:50 user nova-compute[82522]:   <metadata>
Apr 17 10:49:50 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:49:50 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:49:50 user nova-compute[82522]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1095013513</nova:name>
Apr 17 10:49:50 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:49:50</nova:creationTime>
Apr 17 10:49:50 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:49:50 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:49:50 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:49:50 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:49:50 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:49:50 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:49:50 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:49:50 user nova-compute[82522]:       <nova:owner>
Apr 17 10:49:50 user nova-compute[82522]:         <nova:user uuid="30ad2b6b478547e78e2cf273ef0390ed">tempest-VolumesSnapshotTestJSON-1076174579-project-member</nova:user>
Apr 17 10:49:50 user nova-compute[82522]:         <nova:project uuid="652f9a7f20954e23b143e349c538f418">tempest-VolumesSnapshotTestJSON-1076174579</nova:project>
Apr 17 10:49:50 user nova-compute[82522]:       </nova:owner>
Apr 17 10:49:50 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:49:50 user nova-compute[82522]:       <nova:ports>
Apr 17 10:49:50 user nova-compute[82522]:         <nova:port uuid="63e11d1a-088d-4c09-b938-48d54ba791fd">
Apr 17 10:49:50 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 10:49:50 user nova-compute[82522]:         </nova:port>
Apr 17 10:49:50 user nova-compute[82522]:       </nova:ports>
Apr 17 10:49:50 user nova-compute[82522]:     </nova:instance>
Apr 17 10:49:50 user nova-compute[82522]:   </metadata>
Apr 17 10:49:50 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:49:50 user nova-compute[82522]:     <system>
Apr 17 10:49:50 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:49:50 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:49:50 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:49:50 user nova-compute[82522]:       <entry name="serial">7fabb8d9-4062-418a-b890-48c4b45cf9cf</entry>
Apr 17 10:49:50 user nova-compute[82522]:       <entry name="uuid">7fabb8d9-4062-418a-b890-48c4b45cf9cf</entry>
Apr 17 10:49:50 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:49:50 user nova-compute[82522]:     </system>
Apr 17 10:49:50 user nova-compute[82522]:   </sysinfo>
Apr 17 10:49:50 user nova-compute[82522]:   <os>
Apr 17 10:49:50 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:49:50 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:49:50 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:49:50 user nova-compute[82522]:   </os>
Apr 17 10:49:50 user nova-compute[82522]:   <features>
Apr 17 10:49:50 user nova-compute[82522]:     <acpi/>
Apr 17 10:49:50 user nova-compute[82522]:     <apic/>
Apr 17 10:49:50 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:49:50 user nova-compute[82522]:   </features>
Apr 17 10:49:50 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:49:50 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:49:50 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:49:50 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:49:50 user nova-compute[82522]:   </clock>
Apr 17 10:49:50 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:49:50 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:49:50 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:49:50 user nova-compute[82522]:   </cpu>
Apr 17 10:49:50 user nova-compute[82522]:   <devices>
Apr 17 10:49:50 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:49:50 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:49:50 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk"/>
Apr 17 10:49:50 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:49:50 user nova-compute[82522]:     </disk>
Apr 17 10:49:50 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:49:50 user nova-compute[82522]:       <mac address="fa:16:3e:b0:4f:13"/>
Apr 17 10:49:50 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:49:50 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:49:50 user nova-compute[82522]:       <target dev="tap63e11d1a-08"/>
Apr 17 10:49:50 user nova-compute[82522]:     </interface>
Apr 17 10:49:50 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:49:50 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/console.log" append="off"/>
Apr 17 10:49:50 user nova-compute[82522]:     </serial>
Apr 17 10:49:50 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:49:50 user nova-compute[82522]:     <video>
Apr 17 10:49:50 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:49:50 user nova-compute[82522]:     </video>
Apr 17 10:49:50 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:49:50 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:49:50 user nova-compute[82522]:     </rng>
Apr 17 10:49:50 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:49:50 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:49:50 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:49:50 user nova-compute[82522]:     </memballoon>
Apr 17 10:49:50 user nova-compute[82522]:   </devices>
Apr 17 10:49:50 user nova-compute[82522]: </domain>
Apr 17 10:49:50 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1095013513',display_name='tempest-VolumesSnapshotTestJSON-instance-1095013513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1095013513',id=28,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='652f9a7f20954e23b143e349c538f418',ramdisk_id='',reservation_id='r-ugvhb85g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1076174579',owner_user_name='tempest-VolumesSnapshotTestJSON-1076174579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:49:47Z,user_data=None,user_id='30ad2b6b478547e78e2cf273ef0390ed',uuid=7fabb8d9-4062-418a-b890-48c4b45cf9cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converting VIF {"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:4f:13,bridge_name='br-int',has_traffic_filtering=True,id=63e11d1a-088d-4c09-b938-48d54ba791fd,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e11d1a-08') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG os_vif [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:4f:13,bridge_name='br-int',has_traffic_filtering=True,id=63e11d1a-088d-4c09-b938-48d54ba791fd,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e11d1a-08') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63e11d1a-08, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63e11d1a-08, col_values=(('external_ids', {'iface-id': '63e11d1a-088d-4c09-b938-48d54ba791fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:4f:13', 'vm-uuid': '7fabb8d9-4062-418a-b890-48c4b45cf9cf'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:50 user nova-compute[82522]: INFO os_vif [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:4f:13,bridge_name='br-int',has_traffic_filtering=True,id=63e11d1a-088d-4c09-b938-48d54ba791fd,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e11d1a-08')
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No VIF found with MAC fa:16:3e:b0:4f:13, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Updated VIF entry in instance network info cache for port 63e11d1a-088d-4c09-b938-48d54ba791fd. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Updating instance_info_cache with network_info: [{"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:49:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] Releasing lock "refresh_cache-7fabb8d9-4062-418a-b890-48c4b45cf9cf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:49:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received event network-vif-plugged-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:49:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] No waiting events found dispatching network-vif-plugged-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:49:51 user nova-compute[82522]: WARNING nova.compute.manager [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received unexpected event network-vif-plugged-63e11d1a-088d-4c09-b938-48d54ba791fd for instance with vm_state building and task_state spawning.
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728593.8404574, 7fabb8d9-4062-418a-b890-48c4b45cf9cf => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:49:53 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] VM Resumed (Lifecycle Event)
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:49:53 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Instance spawned successfully.
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:49:53 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728593.8461893, 7fabb8d9-4062-418a-b890-48c4b45cf9cf => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:49:53 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] VM Started (Lifecycle Event)
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received event network-vif-plugged-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] No waiting events found dispatching network-vif-plugged-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:49:53 user nova-compute[82522]: WARNING nova.compute.manager [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received unexpected event network-vif-plugged-63e11d1a-088d-4c09-b938-48d54ba791fd for instance with vm_state building and task_state spawning.
Apr 17 10:49:53 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:49:54 user nova-compute[82522]: INFO nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Took 6.43 seconds to spawn the instance on the hypervisor.
Apr 17 10:49:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:49:54 user nova-compute[82522]: INFO nova.compute.manager [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Took 7.58 seconds to build instance.
Apr 17 10:49:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.678s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:49:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:49:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:24 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:25 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 10:50:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 10:50:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received event network-changed-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Refreshing instance network info cache due to event network-changed-d676d231-6c3e-427a-83f1-caab25925cd6. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] Acquiring lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] Acquired lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Refreshing network info cache for port d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:29 user nova-compute[82522]: INFO nova.compute.manager [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Terminating instance
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Updated VIF entry in instance network info cache for port d676d231-6c3e-427a-83f1-caab25925cd6. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.network.neutron [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Updating instance_info_cache with network_info: [{"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] Releasing lock "refresh_cache-a23c573c-7547-4739-bf72-ad8fa8fab7ed" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:50:29 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Instance destroyed successfully.
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.objects.instance [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'resources' on Instance uuid a23c573c-7547-4739-bf72-ad8fa8fab7ed {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-766687741',display_name='tempest-TestStampPattern-server-766687741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-766687741',id=26,image_ref='fa787c35-c17b-4909-bc09-897818a6156f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuLQDJ2Z2AMQjPcpwBXxC60PoD0xwIae5XZ5z7x5L/fK+zl+/qEVvPMCnw86sAZZJR+5qNlBLSq4czZc4jysEkTXetR347vw/3aJ1wazOlhSEz/iMS3Zyr7Za5/g937hg==',key_name='tempest-TestStampPattern-12722321',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84cd384dfcbb4739b9694704c1fad001',ramdisk_id='',reservation_id='r-34sg9hkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d61e9333-fe01-4a9e-abab-ef31ba6d4173',image_min_disk='1',image_min_ram='0',image_owner_id='84cd384dfcbb4739b9694704c1fad001',image_owner_project_name='tempest-TestStampPattern-2056640667',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2056640667-project-member',image_user_id='708740584a3d488da0ee13e5f8299b7f',owner_project_name='tempest-TestStampPattern-2056640667',owner_user_name='tempest-TestStampPattern-2056640667-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:47:42Z,user_data=None,user_id='708740584a3d488da0ee13e5f8299b7f',uuid=a23c573c-7547-4739-bf72-ad8fa8fab7ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converting VIF {"id": "d676d231-6c3e-427a-83f1-caab25925cd6", "address": "fa:16:3e:73:76:0b", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd676d231-6c", "ovs_interfaceid": "d676d231-6c3e-427a-83f1-caab25925cd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=d676d231-6c3e-427a-83f1-caab25925cd6,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd676d231-6c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:50:29 user nova-compute[82522]: DEBUG os_vif [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=d676d231-6c3e-427a-83f1-caab25925cd6,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd676d231-6c') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd676d231-6c, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:50:30 user nova-compute[82522]: INFO os_vif [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=d676d231-6c3e-427a-83f1-caab25925cd6,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd676d231-6c')
Apr 17 10:50:30 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Deleting instance files /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed_del
Apr 17 10:50:30 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Deletion of /opt/stack/data/nova/instances/a23c573c-7547-4739-bf72-ad8fa8fab7ed_del complete
Apr 17 10:50:30 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:50:30 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=7968MB free_disk=26.13201141357422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:30 user nova-compute[82522]: INFO nova.compute.manager [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Took 1.34 seconds to destroy the instance on the hypervisor.
Apr 17 10:50:30 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e198ad00-927f-45e1-9f14-828d56ce3393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance a23c573c-7547-4739-bf72-ad8fa8fab7ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3fd89020-5492-4e40-a911-63f9b1b43315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:50:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received event network-vif-unplugged-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] No waiting events found dispatching network-vif-unplugged-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received event network-vif-unplugged-d676d231-6c3e-427a-83f1-caab25925cd6 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received event network-vif-plugged-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Acquiring lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] No waiting events found dispatching network-vif-plugged-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:50:31 user nova-compute[82522]: WARNING nova.compute.manager [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received unexpected event network-vif-plugged-d676d231-6c3e-427a-83f1-caab25925cd6 for instance with vm_state active and task_state deleting.
Apr 17 10:50:31 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Took 0.63 seconds to deallocate network for instance.
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-6275cecc-11b9-45a9-8964-700436974cae req-3f3a74a9-d31d-479f-8615-831fec702c4f service nova] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Received event network-vif-deleted-d676d231-6c3e-427a-83f1-caab25925cd6 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:31 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Deleted allocations for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "a23c573c-7547-4739-bf72-ad8fa8fab7ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.625s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:50:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:50:32 user nova-compute[82522]: INFO nova.compute.manager [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Unrescuing
Apr 17 10:50:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:50:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquired lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:50:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:50:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:50:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:50:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:50:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:50:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Updating instance_info_cache with network_info: [{"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Releasing lock "refresh_cache-e198ad00-927f-45e1-9f14-828d56ce3393" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'flavor' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-unplugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-unplugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:50:33 user nova-compute[82522]: WARNING nova.compute.manager [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-unplugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:50:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:33 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Instance destroyed successfully.
Apr 17 10:50:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG nova.objects.instance [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'flavor' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:50:35 user nova-compute[82522]: WARNING nova.compute.manager [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:50:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:50:35 user nova-compute[82522]: WARNING nova.compute.manager [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state rescued and task_state unrescuing.
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:35 user nova-compute[82522]: INFO nova.compute.manager [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Attaching volume 0f4bbb72-51fe-46f3-a970-cb6f934f63f3 to /dev/vdb
Apr 17 10:50:35 user nova-compute[82522]: DEBUG os_brick.utils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[32afc4ab-0b98-4f32-9dd5-c39ee5cd5076]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[569ebe03-aa6c-499a-9275-4c0d246d6be4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bdeddc-917a-481e-b178-a41376b62ebb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9026814e-6b45-44aa-8bbd-304d4547413e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:50:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:50:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:50:36 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:50:36 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c242ac-3754-465d-9c0c-fd6544e00aff]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:50:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:50:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:50:36 user nova-compute[82522]: DEBUG os_brick.utils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:50:36 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updating existing volume attachment record: 1716efdd-7f01-4a25-902a-7c6993da62d6 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for e198ad00-927f-45e1-9f14-828d56ce3393 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728637.512445, e198ad00-927f-45e1-9f14-828d56ce3393 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:50:37 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] VM Resumed (Lifecycle Event)
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:50:37 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728637.5130987, e198ad00-927f-45e1-9f14-828d56ce3393 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:50:37 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] VM Started (Lifecycle Event)
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:50:37 user nova-compute[82522]: WARNING nova.compute.manager [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state active and task_state None.
Apr 17 10:50:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:50:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGLpEWkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:50:40 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:50:40 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:50:40 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d535bdb3-4f8c-4819-9741-eee7ee07d009]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:50:40 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cdd99b-dee7-4ec8-b484-87f80be4e781]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3] added
Apr 17 10:50:40 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ed9117-d169-45e5-b324-ed775218fefc]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b12437-af61-4438-aecd-4caf96dd2d8b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGLpEWkd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGLpEWkd" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2e1018-6196-414d-bd1c-c9deefdc4ce7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bGLpEWkd'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec46b3a1-7a3a-48fc-b406-c39b71368cbf]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[119fb9f3-36ba-4e48-a290-1271c9021073]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e9ed58-766c-4239-b56a-5320a4548663]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260]
Apr 17 10:50:41 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260] successful.
Apr 17 10:50:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a392e-fda4-4161-8336-2a4f2c667695]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9aa8e0-44a9-4158-8655-f144548735de]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:50:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[38668ffb-da60-49bc-9628-671e2f1da20f]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:50:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGLpEWkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23132373765316236', 'path': '/dev/sde'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132373765316236', 'path': '/dev/sde'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG nova.objects.instance [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'flavor' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:50:42 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:50:42 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:50:42 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:50:42 user nova-compute[82522]:   <serial>0f4bbb72-51fe-46f3-a970-cb6f934f63f3</serial>
Apr 17 10:50:42 user nova-compute[82522]: </disk>
Apr 17 10:50:42 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No VIF found with MAC fa:16:3e:08:b5:98, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:50:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.952s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:44 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728629.8243067, a23c573c-7547-4739-bf72-ad8fa8fab7ed => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:50:44 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] VM Stopped (Lifecycle Event)
Apr 17 10:50:44 user nova-compute[82522]: DEBUG nova.compute.manager [None req-03536e11-71ff-466b-913a-9b979380b055 None None] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:50:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing instance network info cache due to event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:50:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] Acquiring lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:50:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] Acquired lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:50:51 user nova-compute[82522]: DEBUG nova.network.neutron [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:50:51 user nova-compute[82522]: DEBUG nova.network.neutron [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updated VIF entry in instance network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:50:51 user nova-compute[82522]: DEBUG nova.network.neutron [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updating instance_info_cache with network_info: [{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:50:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] Releasing lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:50:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing instance network info cache due to event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:50:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] Acquiring lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:50:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] Acquired lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:50:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:50:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updated VIF entry in instance network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:50:54 user nova-compute[82522]: DEBUG nova.network.neutron [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updating instance_info_cache with network_info: [{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:50:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] Releasing lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:50:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:57 user nova-compute[82522]: INFO nova.compute.manager [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Rebooting instance
Apr 17 10:50:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:50:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquired lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:50:57 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:50:57 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updating instance_info_cache with network_info: [{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:50:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Releasing lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:50:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:50:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-unplugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] No waiting events found dispatching network-vif-unplugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:50:58 user nova-compute[82522]: WARNING nova.compute.manager [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received unexpected event network-vif-unplugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance with vm_state active and task_state reboot_started_hard.
Apr 17 10:50:58 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Instance destroyed successfully.
Apr 17 10:50:58 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'resources' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1426878970',display_name='tempest-TestMinimumBasicScenario-server-1426878970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1426878970',id=27,image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORcRCSidzCtZERfUBnTDAnNSPELy1dgk6b9Q8gc8T4PAqATO1Uji336+kxtRXvHft6CLIvqnAvnpFG9PPMqkQyHfLPSq8yFarfYxhKHvEuKs5HLwpgj3LQxqJVyr1Uk0w==',key_name='tempest-TestMinimumBasicScenario-893387962',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:48:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='455ea6870abe450ba413ffabf4d4097e',ramdisk_id='',reservation_id='r-crcqn0qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1309632250',owner_user_name='tempest-TestMinimumBasicScenario-1309632250-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:50:58Z,user_data=None,user_id='df693038f49145b9854ae18d246dde2f',uuid=3fd89020-5492-4e40-a911-63f9b1b43315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converting VIF {"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_vif [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65f23819-cc, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:58 user nova-compute[82522]: INFO os_vif [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc')
Apr 17 10:50:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGLpEWkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:50:58 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[26977376-70ff-4eba-bd5f-fef8316f4d20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:50:58 user nova-compute[82522]: No targets found.
Apr 17 10:50:58 user nova-compute[82522]: iSNS:
Apr 17 10:50:58 user nova-compute[82522]: No targets found.
Apr 17 10:50:58 user nova-compute[82522]: STATIC:
Apr 17 10:50:58 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:50:58 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:50:58 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:50:58 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:50:58 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:50:58 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:50:58 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3
Apr 17 10:50:58 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:50:58 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:50:58 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300
Apr 17 10:50:58 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:50:58 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:50:58 user nova-compute[82522]: FIRMWARE:
Apr 17 10:50:58 user nova-compute[82522]: No targets found.
Apr 17 10:50:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:50:58 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:50:58 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff6b39e-ed34-41f7-92a0-aa66fb94855d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8893f3c0-5554-4564-a804-1702bba3a7ad]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:58 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:58 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:58 user nova-compute[82522]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:50:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:58 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:58 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:58 user nova-compute[82522]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:50:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2843b3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3'): ({'sde'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Removing single pathed devices sde {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a8b3f6-2148-4f92-bf67-3a047ab59bae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d91309-099e-43d0-8392-17c40b4b40d5]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flushing IO for device /dev/sde {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4cdcb9-9d44-402f-8fa9-809bb2bf84d9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfce246-28fd-4ed5-b44f-bcbc45ac033c]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c45827-3c2b-4c6e-bb00-c5ea8f3744f0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[746961f7-fefc-44b3-902d-9e661855779d]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260]
Apr 17 10:50:58 user nova-compute[82522]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260] successful.
Apr 17 10:50:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38ee4da-b2c3-4386-988b-71d4080fe3b0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] <== disconnect_volume: return (290ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Start _get_guest_xml network_info=[{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b9a4fcd5-2f1f-4db6-85be-390733594d1f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': 'b9a4fcd5-2f1f-4db6-85be-390733594d1f'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '1716efdd-7f01-4a25-902a-7c6993da62d6', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGLpEWkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3fd89020-5492-4e40-a911-63f9b1b43315', 'attached_at': '', 'detached_at': '', 'volume_id': '0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 'serial': '0f4bbb72-51fe-46f3-a970-cb6f934f63f3'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:50:59 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:50:59 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b9a4fcd5-2f1f-4db6-85be-390733594d1f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGLpEWkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:50:59 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:50:59 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:50:59 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ec9d30-28cc-4952-9391-22af84997ff4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:50:59 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e65d05-ffb0-4a82-a3a8-d65d9458a726]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3] added
Apr 17 10:50:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[52be9b17-5320-4fdc-bca4-251d952ff4ac]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0ea85b-6893-473a-a557-bc28a20af398]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGLpEWkd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGLpEWkd" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8f1ead-319f-45f3-8450-d79810afbdaa]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bGLpEWkd'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[821f94f8-6b4b-44f9-a29b-a5f4893bd7e4]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dcd58d-62e1-413e-a568-a25c6b8712a2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6fea0c-111f-4b1c-a69f-c0056ef693a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260]
Apr 17 10:50:59 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260] successful.
Apr 17 10:50:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae377fb-d449-4a4d-bec0-a6397ba2b675]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0e9bdd-55a6-409c-87a6-14fb0310301c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:50:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b820770-4d6e-42e6-b5a6-04dfecc53d2f]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGLpEWkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "38871910-281e-4aea-9343-79aed3f3b1b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "38871910-281e-4aea-9343-79aed3f3b1b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:50:59 user nova-compute[82522]: INFO nova.compute.claims [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Claim successful on node user
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 10:50:59 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] No waiting events found dispatching network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:51:00 user nova-compute[82522]: WARNING nova.compute.manager [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received unexpected event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance with vm_state active and task_state reboot_started_hard.
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.network.neutron [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:51:00 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:51:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23132373765316236', 'path': '/dev/sde'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132373765316236', 'path': '/dev/sde'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1426878970',display_name='tempest-TestMinimumBasicScenario-server-1426878970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1426878970',id=27,image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORcRCSidzCtZERfUBnTDAnNSPELy1dgk6b9Q8gc8T4PAqATO1Uji336+kxtRXvHft6CLIvqnAvnpFG9PPMqkQyHfLPSq8yFarfYxhKHvEuKs5HLwpgj3LQxqJVyr1Uk0w==',key_name='tempest-TestMinimumBasicScenario-893387962',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:48:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='455ea6870abe450ba413ffabf4d4097e',ramdisk_id='',reservation_id='r-crcqn0qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1309632250',owner_user_name='tempest-TestMinimumBasicScenario-1309632250-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:50:58Z,user_data=None,user_id='df693038f49145b9854ae18d246dde2f',uuid=3fd89020-5492-4e40-a911-63f9b1b43315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converting VIF {"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:51:00 user nova-compute[82522]:   <uuid>3fd89020-5492-4e40-a911-63f9b1b43315</uuid>
Apr 17 10:51:00 user nova-compute[82522]:   <name>instance-0000001b</name>
Apr 17 10:51:00 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:51:00 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:51:00 user nova-compute[82522]:   <metadata>
Apr 17 10:51:00 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:51:00 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:51:00 user nova-compute[82522]:       <nova:name>tempest-TestMinimumBasicScenario-server-1426878970</nova:name>
Apr 17 10:51:00 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:50:59</nova:creationTime>
Apr 17 10:51:00 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:51:00 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:51:00 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:51:00 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:51:00 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:51:00 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:51:00 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:51:00 user nova-compute[82522]:       <nova:owner>
Apr 17 10:51:00 user nova-compute[82522]:         <nova:user uuid="df693038f49145b9854ae18d246dde2f">tempest-TestMinimumBasicScenario-1309632250-project-member</nova:user>
Apr 17 10:51:00 user nova-compute[82522]:         <nova:project uuid="455ea6870abe450ba413ffabf4d4097e">tempest-TestMinimumBasicScenario-1309632250</nova:project>
Apr 17 10:51:00 user nova-compute[82522]:       </nova:owner>
Apr 17 10:51:00 user nova-compute[82522]:       <nova:root type="image" uuid="b9a4fcd5-2f1f-4db6-85be-390733594d1f"/>
Apr 17 10:51:00 user nova-compute[82522]:       <nova:ports>
Apr 17 10:51:00 user nova-compute[82522]:         <nova:port uuid="65f23819-ccfb-4eb0-adc1-3f9895ed9c39">
Apr 17 10:51:00 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 10:51:00 user nova-compute[82522]:         </nova:port>
Apr 17 10:51:00 user nova-compute[82522]:       </nova:ports>
Apr 17 10:51:00 user nova-compute[82522]:     </nova:instance>
Apr 17 10:51:00 user nova-compute[82522]:   </metadata>
Apr 17 10:51:00 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:51:00 user nova-compute[82522]:     <system>
Apr 17 10:51:00 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:51:00 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:51:00 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:51:00 user nova-compute[82522]:       <entry name="serial">3fd89020-5492-4e40-a911-63f9b1b43315</entry>
Apr 17 10:51:00 user nova-compute[82522]:       <entry name="uuid">3fd89020-5492-4e40-a911-63f9b1b43315</entry>
Apr 17 10:51:00 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:51:00 user nova-compute[82522]:     </system>
Apr 17 10:51:00 user nova-compute[82522]:   </sysinfo>
Apr 17 10:51:00 user nova-compute[82522]:   <os>
Apr 17 10:51:00 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:51:00 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:51:00 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:51:00 user nova-compute[82522]:   </os>
Apr 17 10:51:00 user nova-compute[82522]:   <features>
Apr 17 10:51:00 user nova-compute[82522]:     <acpi/>
Apr 17 10:51:00 user nova-compute[82522]:     <apic/>
Apr 17 10:51:00 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:51:00 user nova-compute[82522]:   </features>
Apr 17 10:51:00 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:51:00 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:51:00 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:51:00 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:51:00 user nova-compute[82522]:   </clock>
Apr 17 10:51:00 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:51:00 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:51:00 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:51:00 user nova-compute[82522]:   </cpu>
Apr 17 10:51:00 user nova-compute[82522]:   <devices>
Apr 17 10:51:00 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:51:00 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:51:00 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk"/>
Apr 17 10:51:00 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:51:00 user nova-compute[82522]:     </disk>
Apr 17 10:51:00 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:51:00 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:51:00 user nova-compute[82522]:       <source dev="/dev/sde"/>
Apr 17 10:51:00 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:51:00 user nova-compute[82522]:       <serial>0f4bbb72-51fe-46f3-a970-cb6f934f63f3</serial>
Apr 17 10:51:00 user nova-compute[82522]:     </disk>
Apr 17 10:51:00 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:51:00 user nova-compute[82522]:       <mac address="fa:16:3e:08:b5:98"/>
Apr 17 10:51:00 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:51:00 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:51:00 user nova-compute[82522]:       <target dev="tap65f23819-cc"/>
Apr 17 10:51:00 user nova-compute[82522]:     </interface>
Apr 17 10:51:00 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:51:00 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/console.log" append="off"/>
Apr 17 10:51:00 user nova-compute[82522]:     </serial>
Apr 17 10:51:00 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:51:00 user nova-compute[82522]:     <video>
Apr 17 10:51:00 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:51:00 user nova-compute[82522]:     </video>
Apr 17 10:51:00 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:51:00 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:51:00 user nova-compute[82522]:     </rng>
Apr 17 10:51:00 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:51:00 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:51:00 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:51:00 user nova-compute[82522]:     </memballoon>
Apr 17 10:51:00 user nova-compute[82522]:   </devices>
Apr 17 10:51:00 user nova-compute[82522]: </domain>
Apr 17 10:51:00 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:00 user nova-compute[82522]: INFO nova.virt.block_device [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Booting with volume snapshot feeaead2-197c-4dec-95ed-00c5445d0833 at /dev/vda
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.policy [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603 --force-share --output=json" returned: 0 in 0.167s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:51:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Cannot resize image /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'migration_context' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1426878970',display_name='tempest-TestMinimumBasicScenario-server-1426878970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1426878970',id=27,image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORcRCSidzCtZERfUBnTDAnNSPELy1dgk6b9Q8gc8T4PAqATO1Uji336+kxtRXvHft6CLIvqnAvnpFG9PPMqkQyHfLPSq8yFarfYxhKHvEuKs5HLwpgj3LQxqJVyr1Uk0w==',key_name='tempest-TestMinimumBasicScenario-893387962',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:48:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='455ea6870abe450ba413ffabf4d4097e',ramdisk_id='',reservation_id='r-crcqn0qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1309632250',owner_user_name='tempest-TestMinimumBasicScenario-1309632250-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:50:58Z,user_data=None,user_id='df693038f49145b9854ae18d246dde2f',uuid=3fd89020-5492-4e40-a911-63f9b1b43315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converting VIF {"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG os_vif [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65f23819-cc, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65f23819-cc, col_values=(('external_ids', {'iface-id': '65f23819-ccfb-4eb0-adc1-3f9895ed9c39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:b5:98', 'vm-uuid': '3fd89020-5492-4e40-a911-63f9b1b43315'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:01 user nova-compute[82522]: INFO os_vif [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc')
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.network.neutron [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Successfully created port: 477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.network.neutron [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Successfully updated port: 477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "refresh_cache-38871910-281e-4aea-9343-79aed3f3b1b9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquired lock "refresh_cache-38871910-281e-4aea-9343-79aed3f3b1b9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.network.neutron [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received event network-changed-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Refreshing instance network info cache due to event network-changed-477fa3ea-f59d-4fc6-8eb8-4cf064201e14. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] Acquiring lock "refresh_cache-38871910-281e-4aea-9343-79aed3f3b1b9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:51:01 user nova-compute[82522]: DEBUG nova.network.neutron [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Updating instance_info_cache with network_info: [{"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Releasing lock "refresh_cache-38871910-281e-4aea-9343-79aed3f3b1b9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Instance network_info: |[{"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] Acquired lock "refresh_cache-38871910-281e-4aea-9343-79aed3f3b1b9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG nova.network.neutron [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Refreshing network info cache for port 477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] No waiting events found dispatching network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:51:02 user nova-compute[82522]: WARNING nova.compute.manager [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received unexpected event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance with vm_state active and task_state reboot_started_hard.
Apr 17 10:51:02 user nova-compute[82522]: DEBUG nova.network.neutron [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Updated VIF entry in instance network info cache for port 477fa3ea-f59d-4fc6-8eb8-4cf064201e14. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG nova.network.neutron [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Updating instance_info_cache with network_info: [{"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:51:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] Releasing lock "refresh_cache-38871910-281e-4aea-9343-79aed3f3b1b9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:51:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for 3fd89020-5492-4e40-a911-63f9b1b43315 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728664.683496, 3fd89020-5492-4e40-a911-63f9b1b43315 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:51:04 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] VM Resumed (Lifecycle Event)
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:51:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Instance rebooted successfully.
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:51:04 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728664.6896286, 3fd89020-5492-4e40-a911-63f9b1b43315 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:51:04 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] VM Started (Lifecycle Event)
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.515s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] No waiting events found dispatching network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:51:04 user nova-compute[82522]: WARNING nova.compute.manager [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received unexpected event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance with vm_state active and task_state None.
Apr 17 10:51:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG os_brick.utils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9fbf86-e36b-4e08-8920-e7d9cae27bc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6cd71c-3a6b-44d7-8257-809a8041fcd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4b0245-412c-4b04-9734-85b9636d5def]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce8a00-3aec-4d30-98ef-e73e622d929a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:51:06 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:51:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3d8303-4c21-4b7c-bae3-c32c11d83bd9]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG os_brick.utils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:51:06 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Updating existing volume attachment record: c3e51275-c423-45fd-91fc-6a6060f9870a {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:51:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:51:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Creating image(s)
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Ensure instance console log exists: /opt/stack/data/nova/instances/38871910-281e-4aea-9343-79aed3f3b1b9/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Start _get_guest_xml network_info=[{"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'c3e51275-c423-45fd-91fc-6a6060f9870a', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLnJdPKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38871910-281e-4aea-9343-79aed3f3b1b9', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2f67705-01e4-4e01-a4e4-09b26b62d758', 'serial': 'd2f67705-01e4-4e01-a4e4-09b26b62d758'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:51:10 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:51:10 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:51:10 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLnJdPKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:51:11 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:51:11 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:51:11 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6b0ee1-4224-49ca-8d96-25b415a7b1d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:51:11 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec57828c-4b2a-4210-90c4-5580707e68b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758] added
Apr 17 10:51:11 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa4bdd4-0fe9-4986-a646-1f55de7b0269]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[41068432-70e7-44ae-9580-b09fa4526758]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLnJdPKk {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLnJdPKk" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8170e591-1b0c-4bfc-9460-89c9c5270511]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BLnJdPKk'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86db2d6-cbc1-42a2-a744-b1e617333b4e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3172bdaa-cbb6-4149-ba22-c9343ffdec96]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af1286e-b709-4546-a142-7b38f0ab48a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758, portal: 172.16.0.220,3260]
Apr 17 10:51:11 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758, portal: 172.16.0.220,3260] successful.
Apr 17 10:51:11 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39edab8-16fd-4332-88d5-18b86bfe27d4]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a11e83-efb6-4a32-9312-2505b516824c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:51:11 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb2f686-087f-49f8-84b4-f7d40e2e862c]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:51:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLnJdPKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26430643032616439', 'path': '/dev/sdf'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430643032616439', 'path': '/dev/sdf'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-492012460',display_name='tempest-TestVolumeBootPattern-server-492012460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-492012460',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-kqs45404',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:51:00Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=38871910-281e-4aea-9343-79aed3f3b1b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:95:67,bridge_name='br-int',has_traffic_filtering=True,id=477fa3ea-f59d-4fc6-8eb8-4cf064201e14,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477fa3ea-f5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.objects.instance [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'pci_devices' on Instance uuid 38871910-281e-4aea-9343-79aed3f3b1b9 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:51:12 user nova-compute[82522]:   <uuid>38871910-281e-4aea-9343-79aed3f3b1b9</uuid>
Apr 17 10:51:12 user nova-compute[82522]:   <name>instance-0000001d</name>
Apr 17 10:51:12 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:51:12 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:51:12 user nova-compute[82522]:   <metadata>
Apr 17 10:51:12 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:51:12 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:51:12 user nova-compute[82522]:       <nova:name>tempest-TestVolumeBootPattern-server-492012460</nova:name>
Apr 17 10:51:12 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:51:10</nova:creationTime>
Apr 17 10:51:12 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:51:12 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:51:12 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:51:12 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:51:12 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:51:12 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:51:12 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:51:12 user nova-compute[82522]:       <nova:owner>
Apr 17 10:51:12 user nova-compute[82522]:         <nova:user uuid="0e4ed1192974484bba2d4392f4d011c2">tempest-TestVolumeBootPattern-1777404437-project-member</nova:user>
Apr 17 10:51:12 user nova-compute[82522]:         <nova:project uuid="4fc3b8e3925847d48b522206a8875d3f">tempest-TestVolumeBootPattern-1777404437</nova:project>
Apr 17 10:51:12 user nova-compute[82522]:       </nova:owner>
Apr 17 10:51:12 user nova-compute[82522]:       <nova:ports>
Apr 17 10:51:12 user nova-compute[82522]:         <nova:port uuid="477fa3ea-f59d-4fc6-8eb8-4cf064201e14">
Apr 17 10:51:12 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:51:12 user nova-compute[82522]:         </nova:port>
Apr 17 10:51:12 user nova-compute[82522]:       </nova:ports>
Apr 17 10:51:12 user nova-compute[82522]:     </nova:instance>
Apr 17 10:51:12 user nova-compute[82522]:   </metadata>
Apr 17 10:51:12 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:51:12 user nova-compute[82522]:     <system>
Apr 17 10:51:12 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:51:12 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:51:12 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:51:12 user nova-compute[82522]:       <entry name="serial">38871910-281e-4aea-9343-79aed3f3b1b9</entry>
Apr 17 10:51:12 user nova-compute[82522]:       <entry name="uuid">38871910-281e-4aea-9343-79aed3f3b1b9</entry>
Apr 17 10:51:12 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:51:12 user nova-compute[82522]:     </system>
Apr 17 10:51:12 user nova-compute[82522]:   </sysinfo>
Apr 17 10:51:12 user nova-compute[82522]:   <os>
Apr 17 10:51:12 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:51:12 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:51:12 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:51:12 user nova-compute[82522]:   </os>
Apr 17 10:51:12 user nova-compute[82522]:   <features>
Apr 17 10:51:12 user nova-compute[82522]:     <acpi/>
Apr 17 10:51:12 user nova-compute[82522]:     <apic/>
Apr 17 10:51:12 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:51:12 user nova-compute[82522]:   </features>
Apr 17 10:51:12 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:51:12 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:51:12 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:51:12 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:51:12 user nova-compute[82522]:   </clock>
Apr 17 10:51:12 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:51:12 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:51:12 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:51:12 user nova-compute[82522]:   </cpu>
Apr 17 10:51:12 user nova-compute[82522]:   <devices>
Apr 17 10:51:12 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:51:12 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:51:12 user nova-compute[82522]:       <source dev="/dev/sdf"/>
Apr 17 10:51:12 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:51:12 user nova-compute[82522]:       <serial>d2f67705-01e4-4e01-a4e4-09b26b62d758</serial>
Apr 17 10:51:12 user nova-compute[82522]:     </disk>
Apr 17 10:51:12 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:51:12 user nova-compute[82522]:       <mac address="fa:16:3e:27:95:67"/>
Apr 17 10:51:12 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:51:12 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:51:12 user nova-compute[82522]:       <target dev="tap477fa3ea-f5"/>
Apr 17 10:51:12 user nova-compute[82522]:     </interface>
Apr 17 10:51:12 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:51:12 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/38871910-281e-4aea-9343-79aed3f3b1b9/console.log" append="off"/>
Apr 17 10:51:12 user nova-compute[82522]:     </serial>
Apr 17 10:51:12 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:51:12 user nova-compute[82522]:     <video>
Apr 17 10:51:12 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:51:12 user nova-compute[82522]:     </video>
Apr 17 10:51:12 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:51:12 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:51:12 user nova-compute[82522]:     </rng>
Apr 17 10:51:12 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:51:12 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:51:12 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:51:12 user nova-compute[82522]:     </memballoon>
Apr 17 10:51:12 user nova-compute[82522]:   </devices>
Apr 17 10:51:12 user nova-compute[82522]: </domain>
Apr 17 10:51:12 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-492012460',display_name='tempest-TestVolumeBootPattern-server-492012460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-492012460',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-kqs45404',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:51:00Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=38871910-281e-4aea-9343-79aed3f3b1b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:95:67,bridge_name='br-int',has_traffic_filtering=True,id=477fa3ea-f59d-4fc6-8eb8-4cf064201e14,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477fa3ea-f5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG os_vif [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:95:67,bridge_name='br-int',has_traffic_filtering=True,id=477fa3ea-f59d-4fc6-8eb8-4cf064201e14,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477fa3ea-f5') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap477fa3ea-f5, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap477fa3ea-f5, col_values=(('external_ids', {'iface-id': '477fa3ea-f59d-4fc6-8eb8-4cf064201e14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:95:67', 'vm-uuid': '38871910-281e-4aea-9343-79aed3f3b1b9'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:12 user nova-compute[82522]: INFO os_vif [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:95:67,bridge_name='br-int',has_traffic_filtering=True,id=477fa3ea-f59d-4fc6-8eb8-4cf064201e14,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477fa3ea-f5')
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:51:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No VIF found with MAC fa:16:3e:27:95:67, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:51:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:13 user nova-compute[82522]: DEBUG nova.compute.manager [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received event network-vif-plugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] Acquiring lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:13 user nova-compute[82522]: DEBUG nova.compute.manager [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] No waiting events found dispatching network-vif-plugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:51:13 user nova-compute[82522]: WARNING nova.compute.manager [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received unexpected event network-vif-plugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance with vm_state building and task_state spawning.
Apr 17 10:51:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728675.9459438, 38871910-281e-4aea-9343-79aed3f3b1b9 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:51:15 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] VM Resumed (Lifecycle Event)
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:51:15 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Instance spawned successfully.
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:51:15 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:51:15 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728675.947498, 38871910-281e-4aea-9343-79aed3f3b1b9 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:51:15 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] VM Started (Lifecycle Event)
Apr 17 10:51:16 user nova-compute[82522]: DEBUG nova.compute.manager [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received event network-vif-plugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] Acquiring lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:16 user nova-compute[82522]: DEBUG nova.compute.manager [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] No waiting events found dispatching network-vif-plugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:51:16 user nova-compute[82522]: WARNING nova.compute.manager [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received unexpected event network-vif-plugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance with vm_state building and task_state spawning.
Apr 17 10:51:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:51:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:51:16 user nova-compute[82522]: INFO nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Took 5.09 seconds to spawn the instance on the hypervisor.
Apr 17 10:51:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:51:16 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:51:16 user nova-compute[82522]: INFO nova.compute.manager [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Took 16.34 seconds to build instance.
Apr 17 10:51:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "38871910-281e-4aea-9343-79aed3f3b1b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.427s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:26 user nova-compute[82522]: INFO nova.compute.manager [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Terminating instance
Apr 17 10:51:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received event network-changed-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Refreshing instance network info cache due to event network-changed-481e24d2-75a9-47c3-8d22-8573d260e7d3. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] Acquiring lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] Acquired lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG nova.network.neutron [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Refreshing network info cache for port 481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:51:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.network.neutron [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updated VIF entry in instance network info cache for port 481e24d2-75a9-47c3-8d22-8573d260e7d3. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.network.neutron [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updating instance_info_cache with network_info: [{"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] Releasing lock "refresh_cache-d61e9333-fe01-4a9e-abab-ef31ba6d4173" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:51:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Instance destroyed successfully.
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'resources' on Instance uuid d61e9333-fe01-4a9e-abab-ef31ba6d4173 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1766110854',display_name='tempest-TestStampPattern-server-1766110854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1766110854',id=21,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuLQDJ2Z2AMQjPcpwBXxC60PoD0xwIae5XZ5z7x5L/fK+zl+/qEVvPMCnw86sAZZJR+5qNlBLSq4czZc4jysEkTXetR347vw/3aJ1wazOlhSEz/iMS3Zyr7Za5/g937hg==',key_name='tempest-TestStampPattern-12722321',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84cd384dfcbb4739b9694704c1fad001',ramdisk_id='',reservation_id='r-fjj65jgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2056640667',owner_user_name='tempest-TestStampPattern-2056640667-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:47:30Z,user_data=None,user_id='708740584a3d488da0ee13e5f8299b7f',uuid=d61e9333-fe01-4a9e-abab-ef31ba6d4173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converting VIF {"id": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "address": "fa:16:3e:5d:60:7d", "network": {"id": "01d90d12-f4b4-4119-ae59-f973d369d909", "bridge": "br-int", "label": "tempest-TestStampPattern-38391664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84cd384dfcbb4739b9694704c1fad001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481e24d2-75", "ovs_interfaceid": "481e24d2-75a9-47c3-8d22-8573d260e7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:60:7d,bridge_name='br-int',has_traffic_filtering=True,id=481e24d2-75a9-47c3-8d22-8573d260e7d3,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481e24d2-75') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG os_vif [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:60:7d,bridge_name='br-int',has_traffic_filtering=True,id=481e24d2-75a9-47c3-8d22-8573d260e7d3,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481e24d2-75') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap481e24d2-75, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:51:27 user nova-compute[82522]: INFO os_vif [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:60:7d,bridge_name='br-int',has_traffic_filtering=True,id=481e24d2-75a9-47c3-8d22-8573d260e7d3,network=Network(01d90d12-f4b4-4119-ae59-f973d369d909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481e24d2-75')
Apr 17 10:51:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Deleting instance files /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173_del
Apr 17 10:51:27 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Deletion of /opt/stack/data/nova/instances/d61e9333-fe01-4a9e-abab-ef31ba6d4173_del complete
Apr 17 10:51:27 user nova-compute[82522]: INFO nova.compute.manager [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:27 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:28 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid 'd61e9333-fe01-4a9e-abab-ef31ba6d4173' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd61e9333-fe01-4a9e-abab-ef31ba6d4173' (instance-00000015)
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:28 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Took 1.20 seconds to deallocate network for instance.
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received event network-vif-deleted-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:28 user nova-compute[82522]: INFO nova.compute.manager [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Neutron deleted interface 481e24d2-75a9-47c3-8d22-8573d260e7d3; detaching it from the instance and deleting it from the info cache
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.network.neutron [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received event network-vif-unplugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] No waiting events found dispatching network-vif-unplugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received event network-vif-unplugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received event network-vif-plugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Acquiring lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] No waiting events found dispatching network-vif-plugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:51:28 user nova-compute[82522]: WARNING nova.compute.manager [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Received unexpected event network-vif-plugged-481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance with vm_state active and task_state deleting.
Apr 17 10:51:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Detach interface failed, port_id=481e24d2-75a9-47c3-8d22-8573d260e7d3, reason: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.779s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:51:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=7940MB free_disk=26.19116973876953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:29 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Deleted allocations for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173
Apr 17 10:51:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "d61e9333-fe01-4a9e-abab-ef31ba6d4173" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.036s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance e198ad00-927f-45e1-9f14-828d56ce3393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3fd89020-5492-4e40-a911-63f9b1b43315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 38871910-281e-4aea-9343-79aed3f3b1b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:51:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:51:30 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:51:30 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:51:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:51:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 60008675-7786-4a26-9640-49da6efd0adb {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updating instance_info_cache with network_info: [{"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-60008675-7786-4a26-9640-49da6efd0adb" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:51:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:51:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 60008675-7786-4a26-9640-49da6efd0adb {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 7fabb8d9-4062-418a-b890-48c4b45cf9cf {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 38871910-281e-4aea-9343-79aed3f3b1b9 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "60008675-7786-4a26-9640-49da6efd0adb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "60008675-7786-4a26-9640-49da6efd0adb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "e198ad00-927f-45e1-9f14-828d56ce3393" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "38871910-281e-4aea-9343-79aed3f3b1b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "38871910-281e-4aea-9343-79aed3f3b1b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "60008675-7786-4a26-9640-49da6efd0adb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "e198ad00-927f-45e1-9f14-828d56ce3393" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "38871910-281e-4aea-9343-79aed3f3b1b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'flavor' on Instance uuid 7fabb8d9-4062-418a-b890-48c4b45cf9cf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:51:36 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Ignoring supplied device name: /dev/vdb
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:51:36 user nova-compute[82522]: INFO nova.compute.manager [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Attaching volume 20b74da5-efb5-4d50-9628-f5170c25ca00 to /dev/vdb
Apr 17 10:51:36 user nova-compute[82522]: DEBUG os_brick.utils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fbf007-ae49-41bb-b413-c5e7edc651e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eff9ee4-1e1f-44b0-956e-283b7c33ec56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca564f0c-ea80-4b2c-8e61-b4100277f959]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca21884-cb58-47b4-9f4d-61a1dc9227f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:51:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:51:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:51:37 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:51:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96824da-b555-413c-a5a5-bf887d2fe1e2]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:51:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:51:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:51:37 user nova-compute[82522]: DEBUG os_brick.utils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:51:37 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Updating existing volume attachment record: 7b1149bf-c89f-44e1-bdb0-f11daa6ddeed {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:51:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVzCqWFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:51:41 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:51:41 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:51:41 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2221e516-1fe0-4289-a63d-6df69a07f45f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:51:41 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[041277b8-5399-4210-8ca4-c18e9df8a562]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00] added
Apr 17 10:51:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[77af6ad9-f92f-47a1-b993-67f79fe84fdb]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88e63a3-82a0-4f7b-b6b5-67df0588872d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OVzCqWFt {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OVzCqWFt" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcbbc85-5719-45b0-8f08-8c6bd1caf0a8]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OVzCqWFt'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa153265-95ac-49cd-9432-af6f88257598]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdfeecc-00ab-4e7a-b62e-8511e5f0b79e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[14de68aa-40a1-43c4-b6c5-5004df5f622a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00, portal: 172.16.0.220,3260]
Apr 17 10:51:41 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00, portal: 172.16.0.220,3260] successful.
Apr 17 10:51:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb21b59-1ecb-4c5a-a3b0-95c876b9a478]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e70507-1709-4b84-8957-0818675e86cb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 (non-flash)
Apr 17 10:51:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff07d19-6a7d-4dd0-9346-cfa5acabddbe]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:51:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:51:42 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728687.642428, d61e9333-fe01-4a9e-abab-ef31ba6d4173 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:51:42 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] VM Stopped (Lifecycle Event)
Apr 17 10:51:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-12ae9b1e-de17-42f3-b2a1-09d57f74567c None None] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:51:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:42 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:51:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVzCqWFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:51:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:51:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23632623633613137', 'path': '/dev/sdg'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:51:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632623633613137', 'path': '/dev/sdg'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:51:42 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'flavor' on Instance uuid 7fabb8d9-4062-418a-b890-48c4b45cf9cf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:51:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:51:42 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:51:42 user nova-compute[82522]:   <source dev="/dev/sdg"/>
Apr 17 10:51:42 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:51:42 user nova-compute[82522]:   <serial>20b74da5-efb5-4d50-9628-f5170c25ca00</serial>
Apr 17 10:51:42 user nova-compute[82522]: </disk>
Apr 17 10:51:42 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:51:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:51:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:51:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No VIF found with MAC fa:16:3e:b0:4f:13, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:51:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.582s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:51:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:51:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:04 user nova-compute[82522]: INFO nova.compute.manager [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Detaching volume 20b74da5-efb5-4d50-9628-f5170c25ca00
Apr 17 10:52:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:04 user nova-compute[82522]: INFO nova.virt.block_device [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Attempting to driver detach volume 20b74da5-efb5-4d50-9628-f5170c25ca00 from mountpoint /dev/vdb
Apr 17 10:52:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Attempting to detach device vdb from instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:52:04 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:52:04 user nova-compute[82522]:   <source dev="/dev/sdg"/>
Apr 17 10:52:04 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:52:04 user nova-compute[82522]:   <serial>20b74da5-efb5-4d50-9628-f5170c25ca00</serial>
Apr 17 10:52:04 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:52:04 user nova-compute[82522]: </disk>
Apr 17 10:52:04 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:52:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Successfully detached device vdb from instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf from the persistent domain config.
Apr 17 10:52:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:52:04 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:52:04 user nova-compute[82522]:   <source dev="/dev/sdg"/>
Apr 17 10:52:04 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:52:04 user nova-compute[82522]:   <serial>20b74da5-efb5-4d50-9628-f5170c25ca00</serial>
Apr 17 10:52:04 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:52:04 user nova-compute[82522]: </disk>
Apr 17 10:52:04 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728724.7457721, 7fabb8d9-4062-418a-b890-48c4b45cf9cf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:52:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Successfully detached device vdb from instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf from the live domain config.
Apr 17 10:52:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVzCqWFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:52:04 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbb324b-2329-474e-b4a4-10eeee40d9a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:52:04 user nova-compute[82522]: No targets found.
Apr 17 10:52:04 user nova-compute[82522]: iSNS:
Apr 17 10:52:04 user nova-compute[82522]: No targets found.
Apr 17 10:52:04 user nova-compute[82522]: STATIC:
Apr 17 10:52:04 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758
Apr 17 10:52:04 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:04 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:04 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00
Apr 17 10:52:04 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:04 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:04 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:52:04 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:04 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:04 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:52:04 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:04 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:04 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3
Apr 17 10:52:04 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:04 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:04 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300
Apr 17 10:52:04 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:04 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:04 user nova-compute[82522]: FIRMWARE:
Apr 17 10:52:04 user nova-compute[82522]: No targets found.
Apr 17 10:52:04 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:52:04 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:52:04 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb054d4-b9ef-44dd-a6bd-8799382b303c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0ee162-34b0-47cf-acde-05c636bc4b26]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 (non-flash)
Apr 17 10:52:04 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7c1edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00'): ({'sdg'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Removing single pathed devices sdg {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[910945d0-ce03-4bf1-9f0b-f2a735a64911]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe38734-a4d1-41f3-8942-b955a963eaa5]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flushing IO for device /dev/sdg {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[837f30fd-bb97-4f28-862a-a6f132e1aaf3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd05b0-a137-46b9-8781-a9bf69b04a1c]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] SCSI volumes sdg have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30d534-dcfc-41ec-935f-7051feeaf09e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2818df77-90d9-4877-8d33-16198088cbdb]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00, portal: 172.16.0.220,3260]
Apr 17 10:52:05 user nova-compute[82522]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00, portal: 172.16.0.220,3260] successful.
Apr 17 10:52:05 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab52afe-7cbe-498f-8399-3e7841750ec4]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] <== disconnect_volume: return (326ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'flavor' on Instance uuid 7fabb8d9-4062-418a-b890-48c4b45cf9cf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.540s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:05 user nova-compute[82522]: INFO nova.compute.manager [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Terminating instance
Apr 17 10:52:05 user nova-compute[82522]: DEBUG nova.compute.manager [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:52:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received event network-vif-unplugged-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] No waiting events found dispatching network-vif-unplugged-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received event network-vif-unplugged-63e11d1a-088d-4c09-b938-48d54ba791fd for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Instance destroyed successfully.
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.objects.instance [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'resources' on Instance uuid 7fabb8d9-4062-418a-b890-48c4b45cf9cf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1095013513',display_name='tempest-VolumesSnapshotTestJSON-instance-1095013513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1095013513',id=28,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='652f9a7f20954e23b143e349c538f418',ramdisk_id='',reservation_id='r-ugvhb85g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1076174579',owner_user_name='tempest-VolumesSnapshotTestJSON-1076174579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:49:54Z,user_data=None,user_id='30ad2b6b478547e78e2cf273ef0390ed',uuid=7fabb8d9-4062-418a-b890-48c4b45cf9cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converting VIF {"id": "63e11d1a-088d-4c09-b938-48d54ba791fd", "address": "fa:16:3e:b0:4f:13", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e11d1a-08", "ovs_interfaceid": "63e11d1a-088d-4c09-b938-48d54ba791fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:4f:13,bridge_name='br-int',has_traffic_filtering=True,id=63e11d1a-088d-4c09-b938-48d54ba791fd,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e11d1a-08') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_vif [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:4f:13,bridge_name='br-int',has_traffic_filtering=True,id=63e11d1a-088d-4c09-b938-48d54ba791fd,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e11d1a-08') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63e11d1a-08, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:52:06 user nova-compute[82522]: INFO os_vif [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:4f:13,bridge_name='br-int',has_traffic_filtering=True,id=63e11d1a-088d-4c09-b938-48d54ba791fd,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e11d1a-08')
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVzCqWFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:52:06 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cfab79-1204-48cc-9902-3d376d106f6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:52:06 user nova-compute[82522]: No targets found.
Apr 17 10:52:06 user nova-compute[82522]: iSNS:
Apr 17 10:52:06 user nova-compute[82522]: No targets found.
Apr 17 10:52:06 user nova-compute[82522]: STATIC:
Apr 17 10:52:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758
Apr 17 10:52:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:52:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:52:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3
Apr 17 10:52:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:06 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300
Apr 17 10:52:06 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:06 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:06 user nova-compute[82522]: FIRMWARE:
Apr 17 10:52:06 user nova-compute[82522]: No targets found.
Apr 17 10:52:06 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:52:06 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:52:06 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b74da5-efb5-4d50-9628-f5170c25ca00', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aabcb0-4ba3-4565-af26-6ba99047a2bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64bb1a4-34c9-440f-8934-0aa51449d155]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:06 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:52:06 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:52:06 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:06 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:06 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:06 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:52:06 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:52:06 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:06 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:06 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2846f2440>, {}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Disconnecting from: [] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] <== disconnect_volume: return (76ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:52:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Deleting instance files /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf_del
Apr 17 10:52:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Deletion of /opt/stack/data/nova/instances/7fabb8d9-4062-418a-b890-48c4b45cf9cf_del complete
Apr 17 10:52:06 user nova-compute[82522]: INFO nova.compute.manager [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 17 10:52:06 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:52:06 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:52:07 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:52:07 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Took 0.45 seconds to deallocate network for instance.
Apr 17 10:52:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-bc0e10c6-0731-4a98-a3d2-0430f8a2009f req-093f99c0-b85b-4d0b-a399-0a72ff1cfdda service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received event network-vif-deleted-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:07 user nova-compute[82522]: WARNING nova.volume.cinder [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Attachment 7b1149bf-c89f-44e1-bdb0-f11daa6ddeed does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7b1149bf-c89f-44e1-bdb0-f11daa6ddeed. (HTTP 404) (Request-ID: req-c81def98-5ca4-4748-ae6e-815db45e10c5)
Apr 17 10:52:07 user nova-compute[82522]: INFO nova.compute.manager [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Took 0.02 seconds to detach 1 volumes for instance.
Apr 17 10:52:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:07 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:52:07 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:52:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:07 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Deleted allocations for instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf
Apr 17 10:52:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.844s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received event network-vif-plugged-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] Acquiring lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] Lock "7fabb8d9-4062-418a-b890-48c4b45cf9cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] No waiting events found dispatching network-vif-plugged-63e11d1a-088d-4c09-b938-48d54ba791fd {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:52:08 user nova-compute[82522]: WARNING nova.compute.manager [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Received unexpected event network-vif-plugged-63e11d1a-088d-4c09-b938-48d54ba791fd for instance with vm_state deleted and task_state None.
Apr 17 10:52:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:14 user nova-compute[82522]: INFO nova.compute.manager [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Detaching volume ed14165c-7141-4cb0-816c-aa875719d300
Apr 17 10:52:14 user nova-compute[82522]: INFO nova.virt.block_device [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attempting to driver detach volume ed14165c-7141-4cb0-816c-aa875719d300 from mountpoint /dev/vdb
Apr 17 10:52:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Attempting to detach device vdb from instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:52:14 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:52:14 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:52:14 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:52:14 user nova-compute[82522]:   <serial>ed14165c-7141-4cb0-816c-aa875719d300</serial>
Apr 17 10:52:14 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 10:52:14 user nova-compute[82522]: </disk>
Apr 17 10:52:14 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:52:14 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully detached device vdb from instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 from the persistent domain config.
Apr 17 10:52:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:52:14 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:52:14 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:52:14 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:52:14 user nova-compute[82522]:   <serial>ed14165c-7141-4cb0-816c-aa875719d300</serial>
Apr 17 10:52:14 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 10:52:14 user nova-compute[82522]: </disk>
Apr 17 10:52:14 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728734.6263285, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:52:14 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully detached device vdb from instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 from the live domain config.
Apr 17 10:52:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHKJYASM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:52:14 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e29e80-e104-4c76-9a3b-74ce5be79a41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:52:14 user nova-compute[82522]: No targets found.
Apr 17 10:52:14 user nova-compute[82522]: iSNS:
Apr 17 10:52:14 user nova-compute[82522]: No targets found.
Apr 17 10:52:14 user nova-compute[82522]: STATIC:
Apr 17 10:52:14 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758
Apr 17 10:52:14 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:14 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:14 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:52:14 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:14 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:14 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:52:14 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:14 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:14 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3
Apr 17 10:52:14 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:14 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:14 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300
Apr 17 10:52:14 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:14 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:14 user nova-compute[82522]: FIRMWARE:
Apr 17 10:52:14 user nova-compute[82522]: No targets found.
Apr 17 10:52:14 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:52:14 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:52:14 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[752f5aa5-6228-49d4-b7b3-569bd19f4506]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e87ad-12a8-43cf-9e37-465848fd11f9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:14 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:52:14 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:52:14 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:14 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:14 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:14 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:52:14 user nova-compute[82522]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 (non-flash)
Apr 17 10:52:14 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:14 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:14 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28469b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300'): ({'sdd'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Removing single pathed devices sdd {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[de330691-7639-4d86-a08c-d157be0d498c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e28e53-2346-4da9-9b56-50a9efbb3746]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flushing IO for device /dev/sdd {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2addce-e49a-4dec-a133-228fb93628bd]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9773d79c-340c-42c2-98f2-dcb497fcc542]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[043b89fc-325a-480d-8ef2-0ad9d86be2ff]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cf792d-79e8-4973-8dea-82f2670f188a]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260]
Apr 17 10:52:14 user nova-compute[82522]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300, portal: 172.16.0.220,3260] successful.
Apr 17 10:52:14 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed14165c-7141-4cb0-816c-aa875719d300 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[049e27fe-7b50-4796-8604-08fe86e7ff7d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== disconnect_volume: return (314ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:52:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:52:15 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'flavor' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:52:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.869s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:52:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:21 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728726.6311948, 7fabb8d9-4062-418a-b890-48c4b45cf9cf => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:52:21 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] VM Stopped (Lifecycle Event)
Apr 17 10:52:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d0d58dd3-96a3-4fbc-8515-bc8fef6cd448 None None] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:52:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "e198ad00-927f-45e1-9f14-828d56ce3393" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:23 user nova-compute[82522]: INFO nova.compute.manager [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Terminating instance
Apr 17 10:52:23 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-unplugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-unplugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-unplugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:24 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Instance destroyed successfully.
Apr 17 10:52:24 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'resources' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1712014270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1712014270',id=25,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:48:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-hhn6szt5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:50:38Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=e198ad00-927f-45e1-9f14-828d56ce3393,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "address": "fa:16:3e:03:f3:95", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b03fa35-ea", "ovs_interfaceid": "8b03fa35-eaab-40ea-a06b-afa4bd410981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=8b03fa35-eaab-40ea-a06b-afa4bd410981,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b03fa35-ea') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_vif [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=8b03fa35-eaab-40ea-a06b-afa4bd410981,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b03fa35-ea') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b03fa35-ea, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:52:24 user nova-compute[82522]: INFO os_vif [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=8b03fa35-eaab-40ea-a06b-afa4bd410981,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b03fa35-ea')
Apr 17 10:52:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGHWqeyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:52:24 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[25de5d5b-2638-4304-9bf0-81a1a3c5dd05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:52:24 user nova-compute[82522]: No targets found.
Apr 17 10:52:24 user nova-compute[82522]: iSNS:
Apr 17 10:52:24 user nova-compute[82522]: No targets found.
Apr 17 10:52:24 user nova-compute[82522]: STATIC:
Apr 17 10:52:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758
Apr 17 10:52:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:52:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a
Apr 17 10:52:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3
Apr 17 10:52:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:24 user nova-compute[82522]: FIRMWARE:
Apr 17 10:52:24 user nova-compute[82522]: No targets found.
Apr 17 10:52:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:52:24 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:52:24 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1d3e5b-dd69-45fa-b794-9563d10c62f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e1579f-f921-49c0-b423-a5ed8cda149c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:24 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:52:24 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:24 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:24 user nova-compute[82522]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a (non-flash)
Apr 17 10:52:24 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:24 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2846f2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a'): ({'sdc'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Removing single pathed devices sdc {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf91c8-4f08-4fa7-ad01-ba6d0bcae318]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[966e5d2c-6cf0-40c3-abb7-87bbf402e61d]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flushing IO for device /dev/sdc {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c805fce2-d64d-42bb-93b9-58b96f1af070]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4149a9da-27e1-40b6-9e26-57c57d72268f]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[220fb2d2-1c0f-4de6-bf2c-e2d9d03eddec]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5327a6-acf2-4a36-bc66-452b872594fa]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a, portal: 172.16.0.220,3260]
Apr 17 10:52:24 user nova-compute[82522]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a, portal: 172.16.0.220,3260] successful.
Apr 17 10:52:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b812f1c-bad0-4b89-b9b8-60c3ddc9669a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52cf8a-8fb6-41d2-b315-b9705a17c507]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] <== disconnect_volume: return (319ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:52:24 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Deleting instance files /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393_del
Apr 17 10:52:24 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Deletion of /opt/stack/data/nova/instances/e198ad00-927f-45e1-9f14-828d56ce3393_del complete
Apr 17 10:52:24 user nova-compute[82522]: INFO nova.compute.manager [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 17 10:52:24 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:52:24 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:52:25 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:52:25 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Took 0.49 seconds to deallocate network for instance.
Apr 17 10:52:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-9fcdc563-8c0e-4cf4-92d1-7ca2e56a5dc3 req-7db3601a-225f-45be-84b5-d9b2cd29a635 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-deleted-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:26 user nova-compute[82522]: INFO nova.compute.manager [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Took 0.76 seconds to detach 1 volumes for instance.
Apr 17 10:52:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] Acquiring lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] Lock "e198ad00-927f-45e1-9f14-828d56ce3393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] No waiting events found dispatching network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:52:26 user nova-compute[82522]: WARNING nova.compute.manager [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Received unexpected event network-vif-plugged-8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance with vm_state deleted and task_state None.
Apr 17 10:52:26 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:26 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Deleted allocations for instance e198ad00-927f-45e1-9f14-828d56ce3393
Apr 17 10:52:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "e198ad00-927f-45e1-9f14-828d56ce3393" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.927s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:27 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:28 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:52:29 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8225MB free_disk=26.226898193359375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3fd89020-5492-4e40-a911-63f9b1b43315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 38871910-281e-4aea-9343-79aed3f3b1b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:52:29 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:52:30 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:52:30 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:52:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:52:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:52:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:52:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:52:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:52:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating instance_info_cache with network_info: [{"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:52:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:52:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:52:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:34 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:52:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:52:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:39 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728744.3465977, e198ad00-927f-45e1-9f14-828d56ce3393 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:52:39 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] VM Stopped (Lifecycle Event)
Apr 17 10:52:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-cb98318f-442b-4620-b52b-909fe56a629a None None] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:52:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:52:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:52:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing instance network info cache due to event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:52:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] Acquiring lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:52:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] Acquired lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:52:49 user nova-compute[82522]: DEBUG nova.network.neutron [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updated VIF entry in instance network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updating instance_info_cache with network_info: [{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] Releasing lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.compute.manager [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.compute.manager [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing instance network info cache due to event network-changed-65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] Acquiring lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] Acquired lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Refreshing network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "38871910-281e-4aea-9343-79aed3f3b1b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "38871910-281e-4aea-9343-79aed3f3b1b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:50 user nova-compute[82522]: INFO nova.compute.manager [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Terminating instance
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:50 user nova-compute[82522]: INFO nova.compute.manager [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Detaching volume 0f4bbb72-51fe-46f3-a970-cb6f934f63f3
Apr 17 10:52:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:50 user nova-compute[82522]: INFO nova.virt.block_device [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Attempting to driver detach volume 0f4bbb72-51fe-46f3-a970-cb6f934f63f3 from mountpoint /dev/vdb
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Attempting to detach device vdb from instance 3fd89020-5492-4e40-a911-63f9b1b43315 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:52:50 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:52:50 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:52:50 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:52:50 user nova-compute[82522]:   <serial>0f4bbb72-51fe-46f3-a970-cb6f934f63f3</serial>
Apr 17 10:52:50 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 10:52:50 user nova-compute[82522]: </disk>
Apr 17 10:52:50 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:52:50 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully detached device vdb from instance 3fd89020-5492-4e40-a911-63f9b1b43315 from the persistent domain config.
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3fd89020-5492-4e40-a911-63f9b1b43315 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:52:50 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:52:50 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:52:50 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:52:50 user nova-compute[82522]:   <serial>0f4bbb72-51fe-46f3-a970-cb6f934f63f3</serial>
Apr 17 10:52:50 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 10:52:50 user nova-compute[82522]: </disk>
Apr 17 10:52:50 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.compute.manager [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received event network-vif-unplugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] Acquiring lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.compute.manager [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] No waiting events found dispatching network-vif-unplugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.compute.manager [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received event network-vif-unplugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updated VIF entry in instance network info cache for port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updating instance_info_cache with network_info: [{"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:52:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] Releasing lock "refresh_cache-3fd89020-5492-4e40-a911-63f9b1b43315" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728771.153645, 3fd89020-5492-4e40-a911-63f9b1b43315 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:52:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully detached device vdb from instance 3fd89020-5492-4e40-a911-63f9b1b43315 from the live domain config.
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGLpEWkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:52:51 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03275e3-dca5-4264-abbe-71ad4e974dde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:52:51 user nova-compute[82522]: No targets found.
Apr 17 10:52:51 user nova-compute[82522]: iSNS:
Apr 17 10:52:51 user nova-compute[82522]: No targets found.
Apr 17 10:52:51 user nova-compute[82522]: STATIC:
Apr 17 10:52:51 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758
Apr 17 10:52:51 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:51 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:51 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:52:51 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:51 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:51 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3
Apr 17 10:52:51 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:51 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:51 user nova-compute[82522]: FIRMWARE:
Apr 17 10:52:51 user nova-compute[82522]: No targets found.
Apr 17 10:52:51 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:52:51 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:52:51 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[74188bc6-54bc-4618-9b31-14db54cb3f50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4551d3-a26d-4f94-9e3d-eebaa90f98f5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28442ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3'): ({'sde'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Removing single pathed devices sde {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05c5a71-7e8a-4890-a29d-1ff4549298c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[087f83e4-9475-4dbe-a637-4f089a53fe80]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flushing IO for device /dev/sde {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca54f19-e810-4980-8c28-b151208e1c50]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[130020dd-a376-4fb0-85ce-fe1b099042f2]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec204a-3993-4262-b2ca-f2c06e5a2c49]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[396488e7-1ba7-44df-a29f-d3d24d20c849]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260]
Apr 17 10:52:51 user nova-compute[82522]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3, portal: 172.16.0.220,3260] successful.
Apr 17 10:52:51 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4bbb72-51fe-46f3-a970-cb6f934f63f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6489888-92b6-4572-ba4b-a29043c8c5c4]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] <== disconnect_volume: return (302ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:52:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Instance destroyed successfully.
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'resources' on Instance uuid 38871910-281e-4aea-9343-79aed3f3b1b9 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-492012460',display_name='tempest-TestVolumeBootPattern-server-492012460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-492012460',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:51:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-kqs45404',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:51:16Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=38871910-281e-4aea-9343-79aed3f3b1b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "address": "fa:16:3e:27:95:67", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap477fa3ea-f5", "ovs_interfaceid": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:95:67,bridge_name='br-int',has_traffic_filtering=True,id=477fa3ea-f59d-4fc6-8eb8-4cf064201e14,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477fa3ea-f5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_vif [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:95:67,bridge_name='br-int',has_traffic_filtering=True,id=477fa3ea-f59d-4fc6-8eb8-4cf064201e14,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477fa3ea-f5') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap477fa3ea-f5, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:52:51 user nova-compute[82522]: INFO os_vif [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:95:67,bridge_name='br-int',has_traffic_filtering=True,id=477fa3ea-f59d-4fc6-8eb8-4cf064201e14,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap477fa3ea-f5')
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLnJdPKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:52:51 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[935bc571-2016-41fe-8b9a-77b2d44f2311]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:52:51 user nova-compute[82522]: No targets found.
Apr 17 10:52:51 user nova-compute[82522]: iSNS:
Apr 17 10:52:51 user nova-compute[82522]: No targets found.
Apr 17 10:52:51 user nova-compute[82522]: STATIC:
Apr 17 10:52:51 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758
Apr 17 10:52:51 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:51 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:51 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:52:51 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:52:51 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:52:51 user nova-compute[82522]: FIRMWARE:
Apr 17 10:52:51 user nova-compute[82522]: No targets found.
Apr 17 10:52:51 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:52:51 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:52:51 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a1f357-ed3c-4ddc-8a86-3d078db031c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[344628c0-8134-4c7a-9d11-298ba3c9317f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 (non-flash)
Apr 17 10:52:51 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa284698d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758'): ({'sdf'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Removing single pathed devices sdf {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d4fd11-f203-49b1-beae-2ab3c82566af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[421e00d6-b5ec-4319-bbd3-fb22bd5354c9]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flushing IO for device /dev/sdf {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b4acd-debe-4ff4-be27-c36870a9c489]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cf437c-8b46-48bf-9d28-15d3525290a0]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] SCSI volumes sdf have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[398faa81-62ee-4131-9466-7fcda63f7b1e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeb1d6b-4400-437f-b7a6-a8d334bcd092]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758, portal: 172.16.0.220,3260]
Apr 17 10:52:51 user nova-compute[82522]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758, portal: 172.16.0.220,3260] successful.
Apr 17 10:52:51 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f67705-01e4-4e01-a4e4-09b26b62d758 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f9cecd-c47e-4217-abcb-160b76345e36]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== disconnect_volume: return (306ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:52:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:52:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Deleting instance files /opt/stack/data/nova/instances/38871910-281e-4aea-9343-79aed3f3b1b9_del
Apr 17 10:52:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Deletion of /opt/stack/data/nova/instances/38871910-281e-4aea-9343-79aed3f3b1b9_del complete
Apr 17 10:52:52 user nova-compute[82522]: INFO nova.compute.manager [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Took 1.55 seconds to destroy the instance on the hypervisor.
Apr 17 10:52:52 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'flavor' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.878s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:52:52 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Took 0.76 seconds to deallocate network for instance.
Apr 17 10:52:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received event network-vif-deleted-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:52 user nova-compute[82522]: INFO nova.compute.manager [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Neutron deleted interface 477fa3ea-f59d-4fc6-8eb8-4cf064201e14; detaching it from the instance and deleting it from the info cache
Apr 17 10:52:52 user nova-compute[82522]: DEBUG nova.network.neutron [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received event network-vif-plugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] Acquiring lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] Lock "38871910-281e-4aea-9343-79aed3f3b1b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] No waiting events found dispatching network-vif-plugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:52:52 user nova-compute[82522]: WARNING nova.compute.manager [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Received unexpected event network-vif-plugged-477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance with vm_state active and task_state deleting.
Apr 17 10:52:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Detach interface failed, port_id=477fa3ea-f59d-4fc6-8eb8-4cf064201e14, reason: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:52:53 user nova-compute[82522]: INFO nova.compute.manager [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Took 0.81 seconds to detach 1 volumes for instance.
Apr 17 10:52:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Deleting volume: d2f67705-01e4-4e01-a4e4-09b26b62d758 {{(pid=82522) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 17 10:52:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:52:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:52:53 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:52:53 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:52:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:54 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Deleted allocations for instance 38871910-281e-4aea-9343-79aed3f3b1b9
Apr 17 10:52:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "38871910-281e-4aea-9343-79aed3f3b1b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.650s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:52:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:53:06 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728771.467492, 38871910-281e-4aea-9343-79aed3f3b1b9 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:53:06 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] VM Stopped (Lifecycle Event)
Apr 17 10:53:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-894cd515-9d9c-4d47-9773-351e6862b325 None None] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:53:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:53:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:53:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:53:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:53:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:53:09 user nova-compute[82522]: INFO nova.compute.claims [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Claim successful on node user
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:53:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.policy [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30ad2b6b478547e78e2cf273ef0390ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652f9a7f20954e23b143e349c538f418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:53:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Creating image(s)
Apr 17 10:53:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "/opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "/opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "/opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk 1073741824" returned: 0 in 0.059s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Successfully created port: 0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Cannot resize image /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'migration_context' on Instance uuid 0deb56c2-1224-488f-9d30-4082ec677dc7 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Ensure instance console log exists: /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Successfully updated port: 0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "refresh_cache-0deb56c2-1224-488f-9d30-4082ec677dc7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquired lock "refresh_cache-0deb56c2-1224-488f-9d30-4082ec677dc7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received event network-changed-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.compute.manager [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Refreshing instance network info cache due to event network-changed-0464e1cc-c5eb-4e76-be88-393898a80f3b. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] Acquiring lock "refresh_cache-0deb56c2-1224-488f-9d30-4082ec677dc7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.neutron [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Updating instance_info_cache with network_info: [{"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Releasing lock "refresh_cache-0deb56c2-1224-488f-9d30-4082ec677dc7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Instance network_info: |[{"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] Acquired lock "refresh_cache-0deb56c2-1224-488f-9d30-4082ec677dc7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.neutron [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Refreshing network info cache for port 0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Start _get_guest_xml network_info=[{"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:53:11 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:53:11 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1125305067',display_name='tempest-VolumesSnapshotTestJSON-instance-1125305067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1125305067',id=30,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='652f9a7f20954e23b143e349c538f418',ramdisk_id='',reservation_id='r-r0jfjxc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1076174579',owner_user_name='tempest-VolumesSnapshotTestJSON-1076174579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:53:10Z,user_data=None,user_id='30ad2b6b478547e78e2cf273ef0390ed',uuid=0deb56c2-1224-488f-9d30-4082ec677dc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converting VIF {"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=0464e1cc-c5eb-4e76-be88-393898a80f3b,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464e1cc-c5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'pci_devices' on Instance uuid 0deb56c2-1224-488f-9d30-4082ec677dc7 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:53:11 user nova-compute[82522]:   <uuid>0deb56c2-1224-488f-9d30-4082ec677dc7</uuid>
Apr 17 10:53:11 user nova-compute[82522]:   <name>instance-0000001e</name>
Apr 17 10:53:11 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:53:11 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:53:11 user nova-compute[82522]:   <metadata>
Apr 17 10:53:11 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:53:11 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:53:11 user nova-compute[82522]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1125305067</nova:name>
Apr 17 10:53:11 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:53:11</nova:creationTime>
Apr 17 10:53:11 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:53:11 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:53:11 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:53:11 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:53:11 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:53:11 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:53:11 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:53:11 user nova-compute[82522]:       <nova:owner>
Apr 17 10:53:11 user nova-compute[82522]:         <nova:user uuid="30ad2b6b478547e78e2cf273ef0390ed">tempest-VolumesSnapshotTestJSON-1076174579-project-member</nova:user>
Apr 17 10:53:11 user nova-compute[82522]:         <nova:project uuid="652f9a7f20954e23b143e349c538f418">tempest-VolumesSnapshotTestJSON-1076174579</nova:project>
Apr 17 10:53:11 user nova-compute[82522]:       </nova:owner>
Apr 17 10:53:11 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:53:11 user nova-compute[82522]:       <nova:ports>
Apr 17 10:53:11 user nova-compute[82522]:         <nova:port uuid="0464e1cc-c5eb-4e76-be88-393898a80f3b">
Apr 17 10:53:11 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 10:53:11 user nova-compute[82522]:         </nova:port>
Apr 17 10:53:11 user nova-compute[82522]:       </nova:ports>
Apr 17 10:53:11 user nova-compute[82522]:     </nova:instance>
Apr 17 10:53:11 user nova-compute[82522]:   </metadata>
Apr 17 10:53:11 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:53:11 user nova-compute[82522]:     <system>
Apr 17 10:53:11 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:53:11 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:53:11 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:53:11 user nova-compute[82522]:       <entry name="serial">0deb56c2-1224-488f-9d30-4082ec677dc7</entry>
Apr 17 10:53:11 user nova-compute[82522]:       <entry name="uuid">0deb56c2-1224-488f-9d30-4082ec677dc7</entry>
Apr 17 10:53:11 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:53:11 user nova-compute[82522]:     </system>
Apr 17 10:53:11 user nova-compute[82522]:   </sysinfo>
Apr 17 10:53:11 user nova-compute[82522]:   <os>
Apr 17 10:53:11 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:53:11 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:53:11 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:53:11 user nova-compute[82522]:   </os>
Apr 17 10:53:11 user nova-compute[82522]:   <features>
Apr 17 10:53:11 user nova-compute[82522]:     <acpi/>
Apr 17 10:53:11 user nova-compute[82522]:     <apic/>
Apr 17 10:53:11 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:53:11 user nova-compute[82522]:   </features>
Apr 17 10:53:11 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:53:11 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:53:11 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:53:11 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:53:11 user nova-compute[82522]:   </clock>
Apr 17 10:53:11 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:53:11 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:53:11 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:53:11 user nova-compute[82522]:   </cpu>
Apr 17 10:53:11 user nova-compute[82522]:   <devices>
Apr 17 10:53:11 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:53:11 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:53:11 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk"/>
Apr 17 10:53:11 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:53:11 user nova-compute[82522]:     </disk>
Apr 17 10:53:11 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:53:11 user nova-compute[82522]:       <mac address="fa:16:3e:e8:2c:69"/>
Apr 17 10:53:11 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:53:11 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:53:11 user nova-compute[82522]:       <target dev="tap0464e1cc-c5"/>
Apr 17 10:53:11 user nova-compute[82522]:     </interface>
Apr 17 10:53:11 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:53:11 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/console.log" append="off"/>
Apr 17 10:53:11 user nova-compute[82522]:     </serial>
Apr 17 10:53:11 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:53:11 user nova-compute[82522]:     <video>
Apr 17 10:53:11 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:53:11 user nova-compute[82522]:     </video>
Apr 17 10:53:11 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:53:11 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:53:11 user nova-compute[82522]:     </rng>
Apr 17 10:53:11 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:53:11 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:53:11 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:53:11 user nova-compute[82522]:     </memballoon>
Apr 17 10:53:11 user nova-compute[82522]:   </devices>
Apr 17 10:53:11 user nova-compute[82522]: </domain>
Apr 17 10:53:11 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1125305067',display_name='tempest-VolumesSnapshotTestJSON-instance-1125305067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1125305067',id=30,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='652f9a7f20954e23b143e349c538f418',ramdisk_id='',reservation_id='r-r0jfjxc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1076174579',owner_user_name='tempest-VolumesSnapshotTestJSON-1076174579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:53:10Z,user_data=None,user_id='30ad2b6b478547e78e2cf273ef0390ed',uuid=0deb56c2-1224-488f-9d30-4082ec677dc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converting VIF {"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=0464e1cc-c5eb-4e76-be88-393898a80f3b,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464e1cc-c5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG os_vif [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=0464e1cc-c5eb-4e76-be88-393898a80f3b,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464e1cc-c5') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0464e1cc-c5, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0464e1cc-c5, col_values=(('external_ids', {'iface-id': '0464e1cc-c5eb-4e76-be88-393898a80f3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:2c:69', 'vm-uuid': '0deb56c2-1224-488f-9d30-4082ec677dc7'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:11 user nova-compute[82522]: INFO os_vif [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=0464e1cc-c5eb-4e76-be88-393898a80f3b,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464e1cc-c5')
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No VIF found with MAC fa:16:3e:e8:2c:69, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.neutron [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Updated VIF entry in instance network info cache for port 0464e1cc-c5eb-4e76-be88-393898a80f3b. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG nova.network.neutron [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Updating instance_info_cache with network_info: [{"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:53:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] Releasing lock "refresh_cache-0deb56c2-1224-488f-9d30-4082ec677dc7" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:53:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:13 user nova-compute[82522]: DEBUG nova.compute.manager [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received event network-vif-plugged-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:13 user nova-compute[82522]: DEBUG nova.compute.manager [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] No waiting events found dispatching network-vif-plugged-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:53:13 user nova-compute[82522]: WARNING nova.compute.manager [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received unexpected event network-vif-plugged-0464e1cc-c5eb-4e76-be88-393898a80f3b for instance with vm_state building and task_state spawning.
Apr 17 10:53:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:14 user nova-compute[82522]: INFO nova.compute.manager [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Terminating instance
Apr 17 10:53:14 user nova-compute[82522]: DEBUG nova.compute.manager [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:53:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Instance destroyed successfully.
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.objects.instance [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'resources' on Instance uuid 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141369614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-141369614',id=20,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:43:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-xwt1w01s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:45:49Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "141b2515-71aa-446f-9310-724be1ed6626", "address": "fa:16:3e:fb:c2:c6", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap141b2515-71", "ovs_interfaceid": "141b2515-71aa-446f-9310-724be1ed6626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:c2:c6,bridge_name='br-int',has_traffic_filtering=True,id=141b2515-71aa-446f-9310-724be1ed6626,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap141b2515-71') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG os_vif [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:c2:c6,bridge_name='br-int',has_traffic_filtering=True,id=141b2515-71aa-446f-9310-724be1ed6626,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap141b2515-71') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap141b2515-71, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:53:15 user nova-compute[82522]: INFO os_vif [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:c2:c6,bridge_name='br-int',has_traffic_filtering=True,id=141b2515-71aa-446f-9310-724be1ed6626,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap141b2515-71')
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Deleting instance files /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f_del
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Deletion of /opt/stack/data/nova/instances/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f_del complete
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.compute.manager [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728795.209442, 0deb56c2-1224-488f-9d30-4082ec677dc7 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] VM Resumed (Lifecycle Event)
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Instance spawned successfully.
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received event network-vif-plugged-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] No waiting events found dispatching network-vif-plugged-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:53:15 user nova-compute[82522]: WARNING nova.compute.manager [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received unexpected event network-vif-plugged-0464e1cc-c5eb-4e76-be88-393898a80f3b for instance with vm_state building and task_state spawning.
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received event network-vif-unplugged-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Acquiring lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] No waiting events found dispatching network-vif-unplugged-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received event network-vif-unplugged-141b2515-71aa-446f-9310-724be1ed6626 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received event network-vif-plugged-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Acquiring lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] No waiting events found dispatching network-vif-plugged-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:53:15 user nova-compute[82522]: WARNING nova.compute.manager [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received unexpected event network-vif-plugged-141b2515-71aa-446f-9310-724be1ed6626 for instance with vm_state active and task_state deleting.
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728795.2124443, 0deb56c2-1224-488f-9d30-4082ec677dc7 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] VM Started (Lifecycle Event)
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Took 5.47 seconds to spawn the instance on the hypervisor.
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.compute.manager [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Took 6.10 seconds to build instance.
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.215s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Took 0.64 seconds to deallocate network for instance.
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Received event network-vif-deleted-141b2515-71aa-446f-9310-724be1ed6626 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:15 user nova-compute[82522]: INFO nova.compute.manager [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Neutron deleted interface 141b2515-71aa-446f-9310-724be1ed6626; detaching it from the instance and deleting it from the info cache
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.network.neutron [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Detach interface failed, port_id=141b2515-71aa-446f-9310-724be1ed6626, reason: Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:16 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:53:16 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:53:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:16 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Deleted allocations for instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f
Apr 17 10:53:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.749s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:53:28 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:53:28 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:53:28 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:53:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728795.0398355, 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:53:30 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] VM Stopped (Lifecycle Event)
Apr 17 10:53:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2a7f01c6-5a33-4136-a73b-f220c12cbe3e None None] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:31 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:53:31 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:53:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8329MB free_disk=26.29747772216797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3fd89020-5492-4e40-a911-63f9b1b43315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 0deb56c2-1224-488f-9d30-4082ec677dc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:53:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:53:32 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:53:32 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:53:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:53:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:33 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:53:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:53:34 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:53:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:53:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:53:34 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:53:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:34 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:53:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:53:34 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:53:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:36 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:53:36 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:53:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:53:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:44 user nova-compute[82522]: INFO nova.compute.manager [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Terminating instance
Apr 17 10:53:44 user nova-compute[82522]: DEBUG nova.compute.manager [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-unplugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] No waiting events found dispatching network-vif-unplugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:53:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-unplugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Instance destroyed successfully.
Apr 17 10:53:45 user nova-compute[82522]: DEBUG nova.objects.instance [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'resources' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1426878970',display_name='tempest-TestMinimumBasicScenario-server-1426878970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1426878970',id=27,image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORcRCSidzCtZERfUBnTDAnNSPELy1dgk6b9Q8gc8T4PAqATO1Uji336+kxtRXvHft6CLIvqnAvnpFG9PPMqkQyHfLPSq8yFarfYxhKHvEuKs5HLwpgj3LQxqJVyr1Uk0w==',key_name='tempest-TestMinimumBasicScenario-893387962',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:48:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='455ea6870abe450ba413ffabf4d4097e',ramdisk_id='',reservation_id='r-crcqn0qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b9a4fcd5-2f1f-4db6-85be-390733594d1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1309632250',owner_user_name='tempest-TestMinimumBasicScenario-1309632250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:51:05Z,user_data=None,user_id='df693038f49145b9854ae18d246dde2f',uuid=3fd89020-5492-4e40-a911-63f9b1b43315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converting VIF {"id": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "address": "fa:16:3e:08:b5:98", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f23819-cc", "ovs_interfaceid": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG os_vif [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65f23819-cc, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:53:45 user nova-compute[82522]: INFO os_vif [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b5:98,bridge_name='br-int',has_traffic_filtering=True,id=65f23819-ccfb-4eb0-adc1-3f9895ed9c39,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f23819-cc')
Apr 17 10:53:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Deleting instance files /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315_del
Apr 17 10:53:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Deletion of /opt/stack/data/nova/instances/3fd89020-5492-4e40-a911-63f9b1b43315_del complete
Apr 17 10:53:45 user nova-compute[82522]: INFO nova.compute.manager [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 17 10:53:45 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:53:45 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Took 0.61 seconds to deallocate network for instance.
Apr 17 10:53:45 user nova-compute[82522]: DEBUG nova.compute.manager [req-729ae7e3-6e32-41b7-836f-8f0e47e63a3a req-def7600e-16f7-451e-b701-24acc2d38215 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-deleted-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:46 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:53:46 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:53:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:46 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Deleted allocations for instance 3fd89020-5492-4e40-a911-63f9b1b43315
Apr 17 10:53:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "3fd89020-5492-4e40-a911-63f9b1b43315" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.869s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] Acquiring lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] Lock "3fd89020-5492-4e40-a911-63f9b1b43315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] No waiting events found dispatching network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:53:46 user nova-compute[82522]: WARNING nova.compute.manager [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Received unexpected event network-vif-plugged-65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance with vm_state deleted and task_state None.
Apr 17 10:53:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:53:53 user nova-compute[82522]: INFO nova.compute.claims [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Claim successful on node user
Apr 17 10:53:53 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:53:53 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:53:53 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:53:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:53:54 user nova-compute[82522]: INFO nova.virt.block_device [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Booting with volume f9878792-e314-42e2-8384-f3175679bfb9 at /dev/vda
Apr 17 10:53:54 user nova-compute[82522]: DEBUG nova.policy [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG os_brick.utils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff79a72-acd0-471c-97f0-7e8625eb8349]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bf31a3-a46c-4af5-9f9f-d015a6f562bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[afee8e13-00df-4430-bf72-59ea3915132a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad62d503-db83-402d-bb90-f1600a06b657]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:53:54 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:53:54 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[34196c33-4ac0-4ead-b91a-270ec0bc7db0]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG os_brick.utils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Updating existing volume attachment record: e9fc39ce-686e-4b33-b5c1-62606ca72275 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:53:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Successfully created port: d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Successfully updated port: d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "refresh_cache-109ee5e0-8c02-43c2-9415-48bb0c8c3a06" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquired lock "refresh_cache-109ee5e0-8c02-43c2-9415-48bb0c8c3a06" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received event network-changed-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Refreshing instance network info cache due to event network-changed-d4f89575-0631-4344-ac9f-dfb2211df9a0. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] Acquiring lock "refresh_cache-109ee5e0-8c02-43c2-9415-48bb0c8c3a06" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:53:55 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Updating instance_info_cache with network_info: [{"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:53:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Releasing lock "refresh_cache-109ee5e0-8c02-43c2-9415-48bb0c8c3a06" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:53:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Instance network_info: |[{"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:53:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] Acquired lock "refresh_cache-109ee5e0-8c02-43c2-9415-48bb0c8c3a06" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:53:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Refreshing network info cache for port d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:53:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Updated VIF entry in instance network info cache for port d4f89575-0631-4344-ac9f-dfb2211df9a0. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:53:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Updating instance_info_cache with network_info: [{"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:53:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] Releasing lock "refresh_cache-109ee5e0-8c02-43c2-9415-48bb0c8c3a06" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:53:58 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Creating image(s)
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Ensure instance console log exists: /opt/stack/data/nova/instances/109ee5e0-8c02-43c2-9415-48bb0c8c3a06/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Start _get_guest_xml network_info=[{"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'e9fc39ce-686e-4b33-b5c1-62606ca72275', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeXRrVJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '109ee5e0-8c02-43c2-9415-48bb0c8c3a06', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9878792-e314-42e2-8384-f3175679bfb9', 'serial': 'f9878792-e314-42e2-8384-f3175679bfb9'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:53:58 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:53:58 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeXRrVJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:53:58 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:53:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:53:58 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:53:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:53:58 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c97c904-b116-41e4-bb89-12ca297d746a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:53:58 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a17f9b-cd0d-4b3c-a7ce-e7d0140c5d86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9] added
Apr 17 10:53:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c6457-8bc8-4b90-86e2-c0a0e2419de6]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[828e2e7d-5a30-41bb-bb7e-fe84ea9bdc23]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:53:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeXRrVJa {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeXRrVJa" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b2607-a588-49af-9dd1-a7b949c2dae0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yeXRrVJa'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcba5b2d-9bc7-4ea0-8244-86d2417bd1b9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[260c1100-f13a-4b98-a07a-48aa1b6a4fc2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:53:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:53:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad27468f-d6c1-4560-b882-5d7bfa577023]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9, portal: 172.16.0.220,3260]
Apr 17 10:53:59 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9, portal: 172.16.0.220,3260] successful.
Apr 17 10:53:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[82222bd5-8743-4ffa-94e9-5bc6289c2fd0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b718b0ca-e3c0-4f64-9c9c-6296a92b158a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:53:59 user nova-compute[82522]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:53:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:53:59 user nova-compute[82522]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:53:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6175a3-7394-4b90-8b2a-ff2bef68a76c]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:53:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728825.169618, 3fd89020-5492-4e40-a911-63f9b1b43315 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:54:00 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] VM Stopped (Lifecycle Event)
Apr 17 10:54:00 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeXRrVJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26631656536653236', 'path': '/dev/sdc'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631656536653236', 'path': '/dev/sdc'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-78e80476-74c0-4f03-a334-f9b21cc32a07 None None] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1214588522',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1214588522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1214588522',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-47ey9o0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:53:54Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=109ee5e0-8c02-43c2-9415-48bb0c8c3a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:23:51,bridge_name='br-int',has_traffic_filtering=True,id=d4f89575-0631-4344-ac9f-dfb2211df9a0,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f89575-06') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'pci_devices' on Instance uuid 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:54:00 user nova-compute[82522]:   <uuid>109ee5e0-8c02-43c2-9415-48bb0c8c3a06</uuid>
Apr 17 10:54:00 user nova-compute[82522]:   <name>instance-0000001f</name>
Apr 17 10:54:00 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:54:00 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:54:00 user nova-compute[82522]:   <metadata>
Apr 17 10:54:00 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:54:00 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:54:00 user nova-compute[82522]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1214588522</nova:name>
Apr 17 10:54:00 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:53:58</nova:creationTime>
Apr 17 10:54:00 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:54:00 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:54:00 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:54:00 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:54:00 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:54:00 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:54:00 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:54:00 user nova-compute[82522]:       <nova:owner>
Apr 17 10:54:00 user nova-compute[82522]:         <nova:user uuid="0e4ed1192974484bba2d4392f4d011c2">tempest-TestVolumeBootPattern-1777404437-project-member</nova:user>
Apr 17 10:54:00 user nova-compute[82522]:         <nova:project uuid="4fc3b8e3925847d48b522206a8875d3f">tempest-TestVolumeBootPattern-1777404437</nova:project>
Apr 17 10:54:00 user nova-compute[82522]:       </nova:owner>
Apr 17 10:54:00 user nova-compute[82522]:       <nova:ports>
Apr 17 10:54:00 user nova-compute[82522]:         <nova:port uuid="d4f89575-0631-4344-ac9f-dfb2211df9a0">
Apr 17 10:54:00 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 10:54:00 user nova-compute[82522]:         </nova:port>
Apr 17 10:54:00 user nova-compute[82522]:       </nova:ports>
Apr 17 10:54:00 user nova-compute[82522]:     </nova:instance>
Apr 17 10:54:00 user nova-compute[82522]:   </metadata>
Apr 17 10:54:00 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:54:00 user nova-compute[82522]:     <system>
Apr 17 10:54:00 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:54:00 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:54:00 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:54:00 user nova-compute[82522]:       <entry name="serial">109ee5e0-8c02-43c2-9415-48bb0c8c3a06</entry>
Apr 17 10:54:00 user nova-compute[82522]:       <entry name="uuid">109ee5e0-8c02-43c2-9415-48bb0c8c3a06</entry>
Apr 17 10:54:00 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:54:00 user nova-compute[82522]:     </system>
Apr 17 10:54:00 user nova-compute[82522]:   </sysinfo>
Apr 17 10:54:00 user nova-compute[82522]:   <os>
Apr 17 10:54:00 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:54:00 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:54:00 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:54:00 user nova-compute[82522]:   </os>
Apr 17 10:54:00 user nova-compute[82522]:   <features>
Apr 17 10:54:00 user nova-compute[82522]:     <acpi/>
Apr 17 10:54:00 user nova-compute[82522]:     <apic/>
Apr 17 10:54:00 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:54:00 user nova-compute[82522]:   </features>
Apr 17 10:54:00 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:54:00 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:54:00 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:54:00 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:54:00 user nova-compute[82522]:   </clock>
Apr 17 10:54:00 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:54:00 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:54:00 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:54:00 user nova-compute[82522]:   </cpu>
Apr 17 10:54:00 user nova-compute[82522]:   <devices>
Apr 17 10:54:00 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:54:00 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:54:00 user nova-compute[82522]:       <source dev="/dev/sdc"/>
Apr 17 10:54:00 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:54:00 user nova-compute[82522]:       <serial>f9878792-e314-42e2-8384-f3175679bfb9</serial>
Apr 17 10:54:00 user nova-compute[82522]:     </disk>
Apr 17 10:54:00 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:54:00 user nova-compute[82522]:       <mac address="fa:16:3e:60:23:51"/>
Apr 17 10:54:00 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:54:00 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:54:00 user nova-compute[82522]:       <target dev="tapd4f89575-06"/>
Apr 17 10:54:00 user nova-compute[82522]:     </interface>
Apr 17 10:54:00 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:54:00 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/109ee5e0-8c02-43c2-9415-48bb0c8c3a06/console.log" append="off"/>
Apr 17 10:54:00 user nova-compute[82522]:     </serial>
Apr 17 10:54:00 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:54:00 user nova-compute[82522]:     <video>
Apr 17 10:54:00 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:54:00 user nova-compute[82522]:     </video>
Apr 17 10:54:00 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:54:00 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:54:00 user nova-compute[82522]:     </rng>
Apr 17 10:54:00 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:54:00 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:54:00 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:54:00 user nova-compute[82522]:     </memballoon>
Apr 17 10:54:00 user nova-compute[82522]:   </devices>
Apr 17 10:54:00 user nova-compute[82522]: </domain>
Apr 17 10:54:00 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1214588522',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1214588522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1214588522',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-47ey9o0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:53:54Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=109ee5e0-8c02-43c2-9415-48bb0c8c3a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:23:51,bridge_name='br-int',has_traffic_filtering=True,id=d4f89575-0631-4344-ac9f-dfb2211df9a0,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f89575-06') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG os_vif [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:23:51,bridge_name='br-int',has_traffic_filtering=True,id=d4f89575-0631-4344-ac9f-dfb2211df9a0,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f89575-06') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4f89575-06, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4f89575-06, col_values=(('external_ids', {'iface-id': 'd4f89575-0631-4344-ac9f-dfb2211df9a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:23:51', 'vm-uuid': '109ee5e0-8c02-43c2-9415-48bb0c8c3a06'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:00 user nova-compute[82522]: INFO os_vif [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:23:51,bridge_name='br-int',has_traffic_filtering=True,id=d4f89575-0631-4344-ac9f-dfb2211df9a0,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f89575-06')
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:54:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No VIF found with MAC fa:16:3e:60:23:51, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:54:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received event network-vif-plugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] Acquiring lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] No waiting events found dispatching network-vif-plugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:01 user nova-compute[82522]: WARNING nova.compute.manager [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received unexpected event network-vif-plugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance with vm_state building and task_state spawning.
Apr 17 10:54:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728843.6308813, 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:54:03 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] VM Resumed (Lifecycle Event)
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:54:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Instance spawned successfully.
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:03 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728843.6320407, 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:54:03 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] VM Started (Lifecycle Event)
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:54:03 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:54:03 user nova-compute[82522]: INFO nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Took 4.89 seconds to spawn the instance on the hypervisor.
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received event network-vif-plugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] Acquiring lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] No waiting events found dispatching network-vif-plugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:03 user nova-compute[82522]: WARNING nova.compute.manager [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received unexpected event network-vif-plugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance with vm_state building and task_state spawning.
Apr 17 10:54:03 user nova-compute[82522]: INFO nova.compute.manager [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Took 10.20 seconds to build instance.
Apr 17 10:54:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.283s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:04 user nova-compute[82522]: INFO nova.compute.manager [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Terminating instance
Apr 17 10:54:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-unplugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Instance destroyed successfully.
Apr 17 10:54:05 user nova-compute[82522]: DEBUG nova.objects.instance [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'resources' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1770450591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1770450591',id=13,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:40:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-zpux0ozq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:42:07Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "address": "fa:16:3e:c8:ce:9e", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2acfe658-2d", "ovs_interfaceid": "2acfe658-2dce-4086-b24a-ef0b4c3714f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ce:9e,bridge_name='br-int',has_traffic_filtering=True,id=2acfe658-2dce-4086-b24a-ef0b4c3714f8,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2acfe658-2d') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_vif [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ce:9e,bridge_name='br-int',has_traffic_filtering=True,id=2acfe658-2dce-4086-b24a-ef0b4c3714f8,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2acfe658-2d') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2acfe658-2d, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:54:05 user nova-compute[82522]: INFO os_vif [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ce:9e,bridge_name='br-int',has_traffic_filtering=True,id=2acfe658-2dce-4086-b24a-ef0b4c3714f8,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2acfe658-2d')
Apr 17 10:54:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkayWePI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:54:05 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd47bdc-4c36-4e65-b6b7-44b3746617ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:54:05 user nova-compute[82522]: No targets found.
Apr 17 10:54:05 user nova-compute[82522]: iSNS:
Apr 17 10:54:05 user nova-compute[82522]: No targets found.
Apr 17 10:54:05 user nova-compute[82522]: STATIC:
Apr 17 10:54:05 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9
Apr 17 10:54:05 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:54:05 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:54:05 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169
Apr 17 10:54:05 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:54:05 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:54:05 user nova-compute[82522]: FIRMWARE:
Apr 17 10:54:05 user nova-compute[82522]: No targets found.
Apr 17 10:54:05 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:54:05 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:54:05 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fad54f7-598f-442b-9173-79cd32b8e234]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3531c7-4393-4df3-9631-85f3569f7cba]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:54:05 user nova-compute[82522]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:05 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 (non-flash)
Apr 17 10:54:05 user nova-compute[82522]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:05 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa284793c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b1bef-c30c-4288-a0cf-e619205b1a0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:05 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6ca193-c42e-40de-8da2-e56133fc2f1d]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6215bc06-921c-4151-91ba-18b8df893556]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da6561d-47b4-477a-bafa-a3f821fc209e]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee70e15-b423-4cce-a681-401e95749c78]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[435d43ca-2f64-41b7-b578-563c57ec6a95]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169, portal: 172.16.0.220,3260]
Apr 17 10:54:06 user nova-compute[82522]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169, portal: 172.16.0.220,3260] successful.
Apr 17 10:54:06 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:263e05e5-5c44-4a01-bf88-51f9038d2169 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64bf88c-48c5-4d35-8bbd-371b5d2d9509]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] <== disconnect_volume: return (299ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:54:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Deleting instance files /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab_del
Apr 17 10:54:06 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Deletion of /opt/stack/data/nova/instances/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab_del complete
Apr 17 10:54:06 user nova-compute[82522]: INFO nova.compute.manager [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 17 10:54:06 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:54:06 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Took 0.57 seconds to deallocate network for instance.
Apr 17 10:54:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-deleted-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:06 user nova-compute[82522]: INFO nova.compute.manager [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Neutron deleted interface 2acfe658-2dce-4086-b24a-ef0b4c3714f8; detaching it from the instance and deleting it from the info cache
Apr 17 10:54:06 user nova-compute[82522]: DEBUG nova.network.neutron [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:54:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Detach interface failed, port_id=2acfe658-2dce-4086-b24a-ef0b4c3714f8, reason: Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:54:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] Acquiring lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] No waiting events found dispatching network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:07 user nova-compute[82522]: WARNING nova.compute.manager [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Received unexpected event network-vif-plugged-2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance with vm_state active and task_state deleting.
Apr 17 10:54:07 user nova-compute[82522]: INFO nova.compute.manager [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Took 0.84 seconds to detach 1 volumes for instance.
Apr 17 10:54:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:07 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG nova.objects.instance [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'flavor' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:08 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Deleted allocations for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.207s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:08 user nova-compute[82522]: INFO nova.compute.manager [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attaching volume 38ad981a-53cd-46a2-825a-78feacd3c702 to /dev/vdb
Apr 17 10:54:08 user nova-compute[82522]: DEBUG os_brick.utils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c459783c-7662-4e98-9507-b1f5745d4812]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7529b6b-25c9-4043-bc1f-185b5b1e31f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[98058877-46a8-4cc0-ba03-eabfbd09dc4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b817dc-78aa-478b-b440-3ebfcd840560]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:54:08 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:54:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64cdd5-c132-439d-927c-f7fac03fa270]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG os_brick.utils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:54:08 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating existing volume attachment record: 2ec1d0cd-5893-40a3-95f9-b5a55301b49c {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:54:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:54:12 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:54:12 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:54:12 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8557dfb6-a01c-484f-88bb-eaa81fb92420]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:54:12 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b09cfc-ce1b-400e-9007-211a7d06f0a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702] added
Apr 17 10:54:12 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98c9c4f-4038-4b1e-a27e-d79bbe87d56a]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d0a1fa-6162-4f1d-bdd1-385ba63ef14c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v womeMVRZ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v womeMVRZ" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb7135-730d-4a57-8222-314c565c0ae9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'womeMVRZ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[25899828-bdc7-45a5-9d62-6288b8a5a737]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6359eb43-ca91-4113-9282-73d501f9e49b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b8ff3e-fb0e-4921-8c41-3a390cdadc11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]
Apr 17 10:54:13 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.
Apr 17 10:54:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[817e210e-8191-4ac6-bbfe-1dfa92307639]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a657c2c3-5e12-48fc-9b6e-4f3f76806d24]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:13 user nova-compute[82522]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:54:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:13 user nova-compute[82522]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:54:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3f64d-231a-43ad-a26f-c03210500ed2]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23462616433623138', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462616433623138', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG nova.objects.instance [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'flavor' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:54:14 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:54:14 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 10:54:14 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:54:14 user nova-compute[82522]:   <serial>38ad981a-53cd-46a2-825a-78feacd3c702</serial>
Apr 17 10:54:14 user nova-compute[82522]: </disk>
Apr 17 10:54:14 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No VIF found with MAC fa:16:3e:d3:62:81, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:54:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.501s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Stashing vm_state: active {{(pid=82522) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'pci_requests' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:54:17 user nova-compute[82522]: INFO nova.compute.claims [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Claim successful on node user
Apr 17 10:54:17 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'resources' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:17 user nova-compute[82522]: INFO nova.compute.resource_tracker [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating resource usage from migration 07da10a1-8830-4111-8135-03611084669d
Apr 17 10:54:17 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.334s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:17 user nova-compute[82522]: INFO nova.compute.manager [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Migrating
Apr 17 10:54:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "compute-rpcapi-router" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:54:17 user nova-compute[82522]: INFO nova.compute.rpcapi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 17 10:54:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "compute-rpcapi-router" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:54:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Starting migrate_disk_and_power_off {{(pid=82522) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:18 user nova-compute[82522]: WARNING nova.compute.manager [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state active and task_state resize_migrating.
Apr 17 10:54:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance destroyed successfully.
Apr 17 10:54:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:49:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:54:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:d3:62:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:d3:62:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_vif [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67386c8f-91, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:54:18 user nova-compute[82522]: INFO os_vif [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91')
Apr 17 10:54:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:54:18 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2645b273-4209-4114-9d65-56135fa67a88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:54:18 user nova-compute[82522]: No targets found.
Apr 17 10:54:18 user nova-compute[82522]: iSNS:
Apr 17 10:54:18 user nova-compute[82522]: No targets found.
Apr 17 10:54:18 user nova-compute[82522]: STATIC:
Apr 17 10:54:18 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9
Apr 17 10:54:18 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:54:18 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:54:18 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702
Apr 17 10:54:18 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:54:18 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:54:18 user nova-compute[82522]: FIRMWARE:
Apr 17 10:54:18 user nova-compute[82522]: No targets found.
Apr 17 10:54:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:54:18 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:54:18 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee570ca-6e8a-473a-a107-a37694a5023b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73f410a-3040-4f24-b476-fce8206dd470]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:18 user nova-compute[82522]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:54:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:18 user nova-compute[82522]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:54:18 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28455e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fe9b5f-53b6-43d7-97db-e8b61c421de5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fc4cc7-a2a9-4790-b445-12c69138c569]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f472c04-eace-47df-8d35-3915b8b91ef5]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5791f80c-1fbc-4928-9ee1-b5a0b49aaf72]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:54:18 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d2dedd-85a8-41ff-a461-47c8e7a42c37]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c85554-1897-4f1c-bb2f-34017141c9de]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]
Apr 17 10:54:19 user nova-compute[82522]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.
Apr 17 10:54:19 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[960ec746-f01b-463a-990c-7d514c861ad4]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== disconnect_volume: return (283ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38_resize/disk /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "cp -r /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38_resize/disk /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk" returned: 0 in 0.241s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38_resize/disk.info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk.info {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "cp -r /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38_resize/disk.info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk.info" returned: 0 in 0.032s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG nova.compute.manager [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:20 user nova-compute[82522]: WARNING nova.compute.manager [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state active and task_state resize_migrating.
Apr 17 10:54:20 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Port 67386c8f-911d-4398-b449-42af25f6afe3 binding to destination host user is already ACTIVE {{(pid=82522) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728845.8376334, 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:54:20 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] VM Stopped (Lifecycle Event)
Apr 17 10:54:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b0340842-aa0c-4325-9583-daeec6423d45 None None] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:54:20 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG os_brick.utils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3a293c-87ce-4e53-88cd-34c94f16526d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa1ddc-cb81-442b-8288-7893c07a81c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa89443a-0007-4122-a913-60e855ea5122]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[716f90e8-2d90-48a5-b71f-92d78c63e6a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:54:21 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:54:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[038700f5-fe8b-4368-b191-ca289849ea44]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:54:21 user nova-compute[82522]: DEBUG os_brick.utils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:54:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Starting finish_migration {{(pid=82522) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance directory exists: not creating {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 10:54:26 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Creating image(s)
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Cannot resize image /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Ensure instance console log exists: /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Start _get_guest_xml network_info=[{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:d3:62:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'ef52f850-d322-4175-9e6d-720add40eb62', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38', 'attached_at': '2023-04-17T10:54:26.000000', 'detached_at': '', 'volume_id': '38ad981a-53cd-46a2-825a-78feacd3c702', 'serial': '38ad981a-53cd-46a2-825a-78feacd3c702'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:54:26 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:54:26 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:54:26 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:54:26 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:54:26 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[966a03d5-baea-42e9-9eda-011ec3ef5c1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:54:26 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7ffcc5-8528-42cb-b9ca-9454332ea0dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702] added
Apr 17 10:54:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0317ac-ba98-44cb-9f72-0d0a4fdfd640]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62888b2-6ad7-4984-9bdc-da0e50d6a24a]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v womeMVRZ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v womeMVRZ" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1b8f40-3c1c-446a-ab9d-857c9ad7b1d6]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'womeMVRZ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[412c2185-6e6e-4974-8317-b89935607881]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4614998b-ebe7-4af5-8fa6-55919a2850e2]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1789bb-20a1-41f1-a72c-b908b9d5c2f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]
Apr 17 10:54:26 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.
Apr 17 10:54:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d558bb-6d25-4375-8586-4f62a700b4b6]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6173a7b7-a55b-47fc-820d-843cb90a7756]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:26 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:54:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:54:26 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:54:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[837305e2-d8de-4b39-98a7-167ca171243a]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:26 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23462616433623138', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462616433623138', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:49:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:d3:62:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:d3:62:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:54:27 user nova-compute[82522]:   <uuid>2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</uuid>
Apr 17 10:54:27 user nova-compute[82522]:   <name>instance-00000018</name>
Apr 17 10:54:27 user nova-compute[82522]:   <memory>196608</memory>
Apr 17 10:54:27 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:54:27 user nova-compute[82522]:   <metadata>
Apr 17 10:54:27 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:54:27 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:54:27 user nova-compute[82522]:       <nova:name>tempest-ServerActionsTestJSON-server-1036404855</nova:name>
Apr 17 10:54:27 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:54:26</nova:creationTime>
Apr 17 10:54:27 user nova-compute[82522]:       <nova:flavor name="m1.micro">
Apr 17 10:54:27 user nova-compute[82522]:         <nova:memory>192</nova:memory>
Apr 17 10:54:27 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:54:27 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:54:27 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:54:27 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:54:27 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:54:27 user nova-compute[82522]:       <nova:owner>
Apr 17 10:54:27 user nova-compute[82522]:         <nova:user uuid="a7e218d771db49e88d13d3b088f3d88a">tempest-ServerActionsTestJSON-2107442540-project-member</nova:user>
Apr 17 10:54:27 user nova-compute[82522]:         <nova:project uuid="cc1b39ff9581474b87c58164e5cafa00">tempest-ServerActionsTestJSON-2107442540</nova:project>
Apr 17 10:54:27 user nova-compute[82522]:       </nova:owner>
Apr 17 10:54:27 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:54:27 user nova-compute[82522]:       <nova:ports>
Apr 17 10:54:27 user nova-compute[82522]:         <nova:port uuid="67386c8f-911d-4398-b449-42af25f6afe3">
Apr 17 10:54:27 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:54:27 user nova-compute[82522]:         </nova:port>
Apr 17 10:54:27 user nova-compute[82522]:       </nova:ports>
Apr 17 10:54:27 user nova-compute[82522]:     </nova:instance>
Apr 17 10:54:27 user nova-compute[82522]:   </metadata>
Apr 17 10:54:27 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:54:27 user nova-compute[82522]:     <system>
Apr 17 10:54:27 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:54:27 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:54:27 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:54:27 user nova-compute[82522]:       <entry name="serial">2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</entry>
Apr 17 10:54:27 user nova-compute[82522]:       <entry name="uuid">2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</entry>
Apr 17 10:54:27 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:54:27 user nova-compute[82522]:     </system>
Apr 17 10:54:27 user nova-compute[82522]:   </sysinfo>
Apr 17 10:54:27 user nova-compute[82522]:   <os>
Apr 17 10:54:27 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:54:27 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:54:27 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:54:27 user nova-compute[82522]:   </os>
Apr 17 10:54:27 user nova-compute[82522]:   <features>
Apr 17 10:54:27 user nova-compute[82522]:     <acpi/>
Apr 17 10:54:27 user nova-compute[82522]:     <apic/>
Apr 17 10:54:27 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:54:27 user nova-compute[82522]:   </features>
Apr 17 10:54:27 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:54:27 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:54:27 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:54:27 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:54:27 user nova-compute[82522]:   </clock>
Apr 17 10:54:27 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:54:27 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:54:27 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:54:27 user nova-compute[82522]:   </cpu>
Apr 17 10:54:27 user nova-compute[82522]:   <devices>
Apr 17 10:54:27 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:54:27 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:54:27 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk"/>
Apr 17 10:54:27 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:54:27 user nova-compute[82522]:     </disk>
Apr 17 10:54:27 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:54:27 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:54:27 user nova-compute[82522]:       <source dev="/dev/sdb"/>
Apr 17 10:54:27 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:54:27 user nova-compute[82522]:       <serial>38ad981a-53cd-46a2-825a-78feacd3c702</serial>
Apr 17 10:54:27 user nova-compute[82522]:     </disk>
Apr 17 10:54:27 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:54:27 user nova-compute[82522]:       <mac address="fa:16:3e:d3:62:81"/>
Apr 17 10:54:27 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:54:27 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:54:27 user nova-compute[82522]:       <target dev="tap67386c8f-91"/>
Apr 17 10:54:27 user nova-compute[82522]:     </interface>
Apr 17 10:54:27 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:54:27 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/console.log" append="off"/>
Apr 17 10:54:27 user nova-compute[82522]:     </serial>
Apr 17 10:54:27 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:54:27 user nova-compute[82522]:     <video>
Apr 17 10:54:27 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:54:27 user nova-compute[82522]:     </video>
Apr 17 10:54:27 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:54:27 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:54:27 user nova-compute[82522]:     </rng>
Apr 17 10:54:27 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:54:27 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:54:27 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:54:27 user nova-compute[82522]:     </memballoon>
Apr 17 10:54:27 user nova-compute[82522]:   </devices>
Apr 17 10:54:27 user nova-compute[82522]: </domain>
Apr 17 10:54:27 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:49:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:d3:62:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:d3:62:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG os_vif [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67386c8f-91, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67386c8f-91, col_values=(('external_ids', {'iface-id': '67386c8f-911d-4398-b449-42af25f6afe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:62:81', 'vm-uuid': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:54:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:28 user nova-compute[82522]: INFO os_vif [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91')
Apr 17 10:54:28 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:54:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:54:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No VIF found with MAC fa:16:3e:d3:62:81, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG nova.compute.manager [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:29 user nova-compute[82522]: WARNING nova.compute.manager [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state active and task_state resize_finish.
Apr 17 10:54:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728871.5394585, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:54:31 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Resumed (Lifecycle Event)
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:54:31 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance running successfully.
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Failed to set time: agent not configured {{(pid=82522) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] finish_migration finished successfully. {{(pid=82522) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:54:31 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728871.5513136, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:54:31 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Started (Lifecycle Event)
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:31 user nova-compute[82522]: WARNING nova.compute.manager [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state active and task_state resize_finish.
Apr 17 10:54:31 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:32 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:54:32 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=26.278079986572266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Applying migration context for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 as it has an incoming, in-progress migration 07da10a1-8830-4111-8135-03611084669d. Migration status is finished {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 17 10:54:32 user nova-compute[82522]: INFO nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating resource usage from migration 07da10a1-8830-4111-8135-03611084669d
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 60008675-7786-4a26-9640-49da6efd0adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 0deb56c2-1224-488f-9d30-4082ec677dc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Migration 07da10a1-8830-4111-8135-03611084669d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:37 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:37 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:54:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 10:54:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:54:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:54:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:54:39 user nova-compute[82522]: INFO nova.compute.claims [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Claim successful on node user
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.network.neutron [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:54:39 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.policy [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:54:39 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Creating image(s)
Apr 17 10:54:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "/opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "/opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "46adc6ffd7a0bca521644c244cd2ef2f0dd5438e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "46adc6ffd7a0bca521644c244cd2ef2f0dd5438e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e.part --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e.part --force-share --output=json" returned: 0 in 0.259s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG nova.virt.images [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 3dd99358-1e69-4b00-8c6f-b2c7b3320f3e was qcow2, converting to raw {{(pid=82522) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG nova.privsep.utils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82522) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e.part /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e.converted {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Successfully created port: e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e.part /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e.converted" returned: 0 in 0.352s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e.converted --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "46adc6ffd7a0bca521644c244cd2ef2f0dd5438e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.084s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "46adc6ffd7a0bca521644c244cd2ef2f0dd5438e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "46adc6ffd7a0bca521644c244cd2ef2f0dd5438e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e,backing_fmt=raw /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e,backing_fmt=raw /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk 1073741824" returned: 0 in 0.053s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "46adc6ffd7a0bca521644c244cd2ef2f0dd5438e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Cannot resize image /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.objects.instance [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'migration_context' on Instance uuid bb68ad13-6870-417f-8593-4d41724109f4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Ensure instance console log exists: /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Successfully updated port: e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquired lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing instance network info cache due to event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] Acquiring lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.network.neutron [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating instance_info_cache with network_info: [{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Releasing lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Instance network_info: |[{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] Acquired lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.network.neutron [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Start _get_guest_xml network_info=[{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:54:36Z,direct_url=<?>,disk_format='qcow2',id=3dd99358-1e69-4b00-8c6f-b2c7b3320f3e,min_disk=0,min_ram=0,name='tempest-scenario-img--1150220988',owner='455ea6870abe450ba413ffabf4d4097e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:54:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '3dd99358-1e69-4b00-8c6f-b2c7b3320f3e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:54:41 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:54:41 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:54:36Z,direct_url=<?>,disk_format='qcow2',id=3dd99358-1e69-4b00-8c6f-b2c7b3320f3e,min_disk=0,min_ram=0,name='tempest-scenario-img--1150220988',owner='455ea6870abe450ba413ffabf4d4097e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:54:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1044969384',display_name='tempest-TestMinimumBasicScenario-server-1044969384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1044969384',id=32,image_ref='3dd99358-1e69-4b00-8c6f-b2c7b3320f3e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2LcQKOJIbCueTFlVX50X2EGvDm6laToZFGZ7y29eU+7fJvpuVyKrKflWnfn7Z0uS0xG8jdApM7wiOOz9SiILReN8+PYwYvEof/j98ElqWxcbuwNLVD70dwsz0wd5YmQg==',key_name='tempest-TestMinimumBasicScenario-1990324644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='455ea6870abe450ba413ffabf4d4097e',ramdisk_id='',reservation_id='r-25nmy3ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3dd99358-1e69-4b00-8c6f-b2c7b3320f3e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1309632250',owner_user_name='tempest-TestMinimumBasicScenario-1309632250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:54:39Z,user_data=None,user_id='df693038f49145b9854ae18d246dde2f',uuid=bb68ad13-6870-417f-8593-4d41724109f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converting VIF {"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e139dcf1-9c53-4c70-849f-1a8126e4d347,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape139dcf1-9c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.objects.instance [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'pci_devices' on Instance uuid bb68ad13-6870-417f-8593-4d41724109f4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:54:41 user nova-compute[82522]:   <uuid>bb68ad13-6870-417f-8593-4d41724109f4</uuid>
Apr 17 10:54:41 user nova-compute[82522]:   <name>instance-00000020</name>
Apr 17 10:54:41 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:54:41 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:54:41 user nova-compute[82522]:   <metadata>
Apr 17 10:54:41 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:54:41 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:54:41 user nova-compute[82522]:       <nova:name>tempest-TestMinimumBasicScenario-server-1044969384</nova:name>
Apr 17 10:54:41 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:54:41</nova:creationTime>
Apr 17 10:54:41 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:54:41 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:54:41 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:54:41 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:54:41 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:54:41 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:54:41 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:54:41 user nova-compute[82522]:       <nova:owner>
Apr 17 10:54:41 user nova-compute[82522]:         <nova:user uuid="df693038f49145b9854ae18d246dde2f">tempest-TestMinimumBasicScenario-1309632250-project-member</nova:user>
Apr 17 10:54:41 user nova-compute[82522]:         <nova:project uuid="455ea6870abe450ba413ffabf4d4097e">tempest-TestMinimumBasicScenario-1309632250</nova:project>
Apr 17 10:54:41 user nova-compute[82522]:       </nova:owner>
Apr 17 10:54:41 user nova-compute[82522]:       <nova:root type="image" uuid="3dd99358-1e69-4b00-8c6f-b2c7b3320f3e"/>
Apr 17 10:54:41 user nova-compute[82522]:       <nova:ports>
Apr 17 10:54:41 user nova-compute[82522]:         <nova:port uuid="e139dcf1-9c53-4c70-849f-1a8126e4d347">
Apr 17 10:54:41 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:54:41 user nova-compute[82522]:         </nova:port>
Apr 17 10:54:41 user nova-compute[82522]:       </nova:ports>
Apr 17 10:54:41 user nova-compute[82522]:     </nova:instance>
Apr 17 10:54:41 user nova-compute[82522]:   </metadata>
Apr 17 10:54:41 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:54:41 user nova-compute[82522]:     <system>
Apr 17 10:54:41 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:54:41 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:54:41 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:54:41 user nova-compute[82522]:       <entry name="serial">bb68ad13-6870-417f-8593-4d41724109f4</entry>
Apr 17 10:54:41 user nova-compute[82522]:       <entry name="uuid">bb68ad13-6870-417f-8593-4d41724109f4</entry>
Apr 17 10:54:41 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:54:41 user nova-compute[82522]:     </system>
Apr 17 10:54:41 user nova-compute[82522]:   </sysinfo>
Apr 17 10:54:41 user nova-compute[82522]:   <os>
Apr 17 10:54:41 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:54:41 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:54:41 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:54:41 user nova-compute[82522]:   </os>
Apr 17 10:54:41 user nova-compute[82522]:   <features>
Apr 17 10:54:41 user nova-compute[82522]:     <acpi/>
Apr 17 10:54:41 user nova-compute[82522]:     <apic/>
Apr 17 10:54:41 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:54:41 user nova-compute[82522]:   </features>
Apr 17 10:54:41 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:54:41 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:54:41 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:54:41 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:54:41 user nova-compute[82522]:   </clock>
Apr 17 10:54:41 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:54:41 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:54:41 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:54:41 user nova-compute[82522]:   </cpu>
Apr 17 10:54:41 user nova-compute[82522]:   <devices>
Apr 17 10:54:41 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:54:41 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:54:41 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk"/>
Apr 17 10:54:41 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:54:41 user nova-compute[82522]:     </disk>
Apr 17 10:54:41 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:54:41 user nova-compute[82522]:       <mac address="fa:16:3e:1f:9c:b6"/>
Apr 17 10:54:41 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:54:41 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:54:41 user nova-compute[82522]:       <target dev="tape139dcf1-9c"/>
Apr 17 10:54:41 user nova-compute[82522]:     </interface>
Apr 17 10:54:41 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:54:41 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/console.log" append="off"/>
Apr 17 10:54:41 user nova-compute[82522]:     </serial>
Apr 17 10:54:41 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:54:41 user nova-compute[82522]:     <video>
Apr 17 10:54:41 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:54:41 user nova-compute[82522]:     </video>
Apr 17 10:54:41 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:54:41 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:54:41 user nova-compute[82522]:     </rng>
Apr 17 10:54:41 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:54:41 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:54:41 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:54:41 user nova-compute[82522]:     </memballoon>
Apr 17 10:54:41 user nova-compute[82522]:   </devices>
Apr 17 10:54:41 user nova-compute[82522]: </domain>
Apr 17 10:54:41 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1044969384',display_name='tempest-TestMinimumBasicScenario-server-1044969384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1044969384',id=32,image_ref='3dd99358-1e69-4b00-8c6f-b2c7b3320f3e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2LcQKOJIbCueTFlVX50X2EGvDm6laToZFGZ7y29eU+7fJvpuVyKrKflWnfn7Z0uS0xG8jdApM7wiOOz9SiILReN8+PYwYvEof/j98ElqWxcbuwNLVD70dwsz0wd5YmQg==',key_name='tempest-TestMinimumBasicScenario-1990324644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='455ea6870abe450ba413ffabf4d4097e',ramdisk_id='',reservation_id='r-25nmy3ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3dd99358-1e69-4b00-8c6f-b2c7b3320f3e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1309632250',owner_user_name='tempest-TestMinimumBasicScenario-1309632250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:54:39Z,user_data=None,user_id='df693038f49145b9854ae18d246dde2f',uuid=bb68ad13-6870-417f-8593-4d41724109f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converting VIF {"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e139dcf1-9c53-4c70-849f-1a8126e4d347,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape139dcf1-9c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG os_vif [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e139dcf1-9c53-4c70-849f-1a8126e4d347,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape139dcf1-9c') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape139dcf1-9c, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape139dcf1-9c, col_values=(('external_ids', {'iface-id': 'e139dcf1-9c53-4c70-849f-1a8126e4d347', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:9c:b6', 'vm-uuid': 'bb68ad13-6870-417f-8593-4d41724109f4'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:41 user nova-compute[82522]: INFO os_vif [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e139dcf1-9c53-4c70-849f-1a8126e4d347,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape139dcf1-9c')
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:54:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No VIF found with MAC fa:16:3e:1f:9c:b6, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:54:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updated VIF entry in instance network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:54:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating instance_info_cache with network_info: [{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:54:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] Releasing lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] No waiting events found dispatching network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:43 user nova-compute[82522]: WARNING nova.compute.manager [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received unexpected event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance with vm_state building and task_state spawning.
Apr 17 10:54:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:54:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728885.2817378, bb68ad13-6870-417f-8593-4d41724109f4 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:54:45 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] VM Resumed (Lifecycle Event)
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:54:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Instance spawned successfully.
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:54:45 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728885.284003, bb68ad13-6870-417f-8593-4d41724109f4 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:54:45 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] VM Started (Lifecycle Event)
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:54:45 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.compute.manager [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.compute.manager [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] No waiting events found dispatching network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:45 user nova-compute[82522]: WARNING nova.compute.manager [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received unexpected event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance with vm_state building and task_state spawning.
Apr 17 10:54:45 user nova-compute[82522]: INFO nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Took 5.91 seconds to spawn the instance on the hypervisor.
Apr 17 10:54:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:54:45 user nova-compute[82522]: INFO nova.compute.manager [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Took 6.53 seconds to build instance.
Apr 17 10:54:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.616s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "60008675-7786-4a26-9640-49da6efd0adb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "60008675-7786-4a26-9640-49da6efd0adb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "60008675-7786-4a26-9640-49da6efd0adb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:55 user nova-compute[82522]: INFO nova.compute.manager [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Terminating instance
Apr 17 10:54:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:54:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received event network-vif-unplugged-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] Acquiring lock "60008675-7786-4a26-9640-49da6efd0adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] No waiting events found dispatching network-vif-unplugged-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received event network-vif-unplugged-d6e0e749-1043-40c1-8401-8aae219f3924 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:54:56 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Instance destroyed successfully.
Apr 17 10:54:56 user nova-compute[82522]: DEBUG nova.objects.instance [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'resources' on Instance uuid 60008675-7786-4a26-9640-49da6efd0adb {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-611330270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-611330270',id=1,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:34:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faab4afa0ddf45578232627c2fac2ff8',ramdisk_id='',reservation_id='r-xp74pm1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-933538997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:36:26Z,user_data=None,user_id='d8cb73d24d324903a625e4782270120e',uuid=60008675-7786-4a26-9640-49da6efd0adb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converting VIF {"id": "d6e0e749-1043-40c1-8401-8aae219f3924", "address": "fa:16:3e:da:dc:bf", "network": {"id": "5678ceef-3151-4d42-9106-9996eafd66f1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1165170472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faab4afa0ddf45578232627c2fac2ff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e0e749-10", "ovs_interfaceid": "d6e0e749-1043-40c1-8401-8aae219f3924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:dc:bf,bridge_name='br-int',has_traffic_filtering=True,id=d6e0e749-1043-40c1-8401-8aae219f3924,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e0e749-10') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG os_vif [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:dc:bf,bridge_name='br-int',has_traffic_filtering=True,id=d6e0e749-1043-40c1-8401-8aae219f3924,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e0e749-10') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6e0e749-10, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:54:56 user nova-compute[82522]: INFO os_vif [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:dc:bf,bridge_name='br-int',has_traffic_filtering=True,id=d6e0e749-1043-40c1-8401-8aae219f3924,network=Network(5678ceef-3151-4d42-9106-9996eafd66f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e0e749-10')
Apr 17 10:54:56 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Deleting instance files /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb_del
Apr 17 10:54:56 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Deletion of /opt/stack/data/nova/instances/60008675-7786-4a26-9640-49da6efd0adb_del complete
Apr 17 10:54:56 user nova-compute[82522]: INFO nova.compute.manager [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 17 10:54:56 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:54:56 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 60008675-7786-4a26-9640-49da6efd0adb] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:54:57 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:54:57 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Took 0.45 seconds to deallocate network for instance.
Apr 17 10:54:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:54:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:54:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:57 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Deleted allocations for instance 60008675-7786-4a26-9640-49da6efd0adb
Apr 17 10:54:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "60008675-7786-4a26-9640-49da6efd0adb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received event network-vif-plugged-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] Acquiring lock "60008675-7786-4a26-9640-49da6efd0adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] Lock "60008675-7786-4a26-9640-49da6efd0adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] No waiting events found dispatching network-vif-plugged-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:54:58 user nova-compute[82522]: WARNING nova.compute.manager [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received unexpected event network-vif-plugged-d6e0e749-1043-40c1-8401-8aae219f3924 for instance with vm_state deleted and task_state None.
Apr 17 10:54:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Received event network-vif-deleted-d6e0e749-1043-40c1-8401-8aae219f3924 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'flavor' on Instance uuid 0deb56c2-1224-488f-9d30-4082ec677dc7 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:54:59 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Ignoring supplied device name: /dev/vdb
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:54:59 user nova-compute[82522]: INFO nova.compute.manager [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Attaching volume 9be4f595-6c61-424f-8df8-cdb6fa8383d2 to /dev/vdb
Apr 17 10:54:59 user nova-compute[82522]: DEBUG os_brick.utils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[599a3d42-16ff-46ef-8408-bd6454bb18d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc03b881-0a20-4527-a96c-e89521840594]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9412f231-e341-43ad-b174-50f73a78b5c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaf237b-29fa-4035-aff2-bdbe9ac5e7ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:54:59 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:54:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fd90a1-acb9-43b1-8403-4ae04e95448a]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG os_brick.utils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:54:59 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Updating existing volume attachment record: aa20c97c-016c-4586-8c60-f09ff319f1db {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:55:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGZjDPuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:55:04 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:55:04 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:55:04 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[430b30e9-d4a0-4ca1-b6cd-9f9bfc158b89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:55:04 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[af918c1d-1748-4bd9-9772-7e23ab44f314]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2] added
Apr 17 10:55:04 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2c4cca-32ca-4d6a-9fba-6e1b254b122e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bac2baa-252a-46b3-a71f-ab7432873393]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGZjDPuV {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGZjDPuV" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a69a7d0-be6c-4af5-a7ff-d7a902ab3503]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGZjDPuV'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[47398a9b-79e2-4541-a110-24e3dbf6fee3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2512bd3d-8778-46e1-a59b-4ef8b2e01f1f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8cac5f-5893-4d48-897e-35e4326af203]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2, portal: 172.16.0.220,3260]
Apr 17 10:55:04 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2, portal: 172.16.0.220,3260] successful.
Apr 17 10:55:04 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc292b28-65a1-4ffc-b6f0-895f610c8dd0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6e81ad-8693-45d0-bc1d-d0636501e271]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 (non-flash)
Apr 17 10:55:04 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965af45-78b1-4c28-b1fb-25cc4a56ef90]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:04 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGZjDPuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23837633238393162', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837633238393162', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'flavor' on Instance uuid 0deb56c2-1224-488f-9d30-4082ec677dc7 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:55:05 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:55:05 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:55:05 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:55:05 user nova-compute[82522]:   <serial>9be4f595-6c61-424f-8df8-cdb6fa8383d2</serial>
Apr 17 10:55:05 user nova-compute[82522]: </disk>
Apr 17 10:55:05 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:55:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] No VIF found with MAC fa:16:3e:e8:2c:69, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:55:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.454s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:11 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728896.6703005, 60008675-7786-4a26-9640-49da6efd0adb => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:55:11 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 60008675-7786-4a26-9640-49da6efd0adb] VM Stopped (Lifecycle Event)
Apr 17 10:55:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-0b4ab149-5d61-4d4c-b60d-2b7f91e37994 None None] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:55:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:23 user nova-compute[82522]: INFO nova.compute.manager [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Detaching volume 9be4f595-6c61-424f-8df8-cdb6fa8383d2
Apr 17 10:55:23 user nova-compute[82522]: INFO nova.virt.block_device [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Attempting to driver detach volume 9be4f595-6c61-424f-8df8-cdb6fa8383d2 from mountpoint /dev/vdb
Apr 17 10:55:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Attempting to detach device vdb from instance 0deb56c2-1224-488f-9d30-4082ec677dc7 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:55:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:55:23 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:55:23 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:55:23 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:55:23 user nova-compute[82522]:   <serial>9be4f595-6c61-424f-8df8-cdb6fa8383d2</serial>
Apr 17 10:55:23 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:55:23 user nova-compute[82522]: </disk>
Apr 17 10:55:23 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:55:23 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Successfully detached device vdb from instance 0deb56c2-1224-488f-9d30-4082ec677dc7 from the persistent domain config.
Apr 17 10:55:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0deb56c2-1224-488f-9d30-4082ec677dc7 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:55:23 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:55:23 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:55:23 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 10:55:23 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:55:23 user nova-compute[82522]:   <serial>9be4f595-6c61-424f-8df8-cdb6fa8383d2</serial>
Apr 17 10:55:23 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:55:23 user nova-compute[82522]: </disk>
Apr 17 10:55:23 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:55:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681728924.275234, 0deb56c2-1224-488f-9d30-4082ec677dc7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0deb56c2-1224-488f-9d30-4082ec677dc7 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:55:24 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Successfully detached device vdb from instance 0deb56c2-1224-488f-9d30-4082ec677dc7 from the live domain config.
Apr 17 10:55:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGZjDPuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:55:24 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0b249-e7c1-46aa-9aff-92a2198a9df4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:55:24 user nova-compute[82522]: No targets found.
Apr 17 10:55:24 user nova-compute[82522]: iSNS:
Apr 17 10:55:24 user nova-compute[82522]: No targets found.
Apr 17 10:55:24 user nova-compute[82522]: STATIC:
Apr 17 10:55:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2
Apr 17 10:55:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:55:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:55:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9
Apr 17 10:55:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:55:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:55:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702
Apr 17 10:55:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:55:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:55:24 user nova-compute[82522]: FIRMWARE:
Apr 17 10:55:24 user nova-compute[82522]: No targets found.
Apr 17 10:55:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:55:24 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:55:24 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b8a131-312b-4f07-8a74-50142f8b117f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[59933c43-f032-427a-8334-de3333f5ec22]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:55:24 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:55:24 user nova-compute[82522]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 (non-flash)
Apr 17 10:55:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:55:24 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:55:24 user nova-compute[82522]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 (non-flash)
Apr 17 10:55:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7c1f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2'): ({'sdd'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Removing single pathed devices sdd {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb53c00-30f0-43eb-abed-96f95a2a6bc4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eacc8fe-9cad-4aee-b078-f2e36f8bd31e]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flushing IO for device /dev/sdd {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[597da66a-4fbd-4cc5-88ea-8c91ca064c0a]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3a0127-adb0-46c8-b538-4f6362f14476]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8fe74b-e28c-43d8-826a-ad3d91f6dd73]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ede55-7c15-47ba-98de-471f124af3ff]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2, portal: 172.16.0.220,3260]
Apr 17 10:55:24 user nova-compute[82522]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2, portal: 172.16.0.220,3260] successful.
Apr 17 10:55:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc90ca8d-a037-4f4b-9a6a-e47702175089]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] <== disconnect_volume: return (303ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:55:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.objects.instance [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'flavor' on Instance uuid 0deb56c2-1224-488f-9d30-4082ec677dc7 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.531s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:25 user nova-compute[82522]: INFO nova.compute.manager [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Terminating instance
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received event network-vif-unplugged-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] No waiting events found dispatching network-vif-unplugged-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received event network-vif-unplugged-0464e1cc-c5eb-4e76-be88-393898a80f3b for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:25 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Instance destroyed successfully.
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.objects.instance [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'resources' on Instance uuid 0deb56c2-1224-488f-9d30-4082ec677dc7 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1125305067',display_name='tempest-VolumesSnapshotTestJSON-instance-1125305067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1125305067',id=30,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:53:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='652f9a7f20954e23b143e349c538f418',ramdisk_id='',reservation_id='r-r0jfjxc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1076174579',owner_user_name='tempest-VolumesSnapshotTestJSON-1076174579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:53:15Z,user_data=None,user_id='30ad2b6b478547e78e2cf273ef0390ed',uuid=0deb56c2-1224-488f-9d30-4082ec677dc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converting VIF {"id": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "address": "fa:16:3e:e8:2c:69", "network": {"id": "5b563383-5272-4d22-a617-c3a91d7b84c9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1551162373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "652f9a7f20954e23b143e349c538f418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464e1cc-c5", "ovs_interfaceid": "0464e1cc-c5eb-4e76-be88-393898a80f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=0464e1cc-c5eb-4e76-be88-393898a80f3b,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464e1cc-c5') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG os_vif [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=0464e1cc-c5eb-4e76-be88-393898a80f3b,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464e1cc-c5') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0464e1cc-c5, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:55:25 user nova-compute[82522]: INFO os_vif [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=0464e1cc-c5eb-4e76-be88-393898a80f3b,network=Network(5b563383-5272-4d22-a617-c3a91d7b84c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464e1cc-c5')
Apr 17 10:55:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGZjDPuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:55:25 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:55:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:55:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[637e686e-4fc1-44e1-a17a-e7087802559d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:55:26 user nova-compute[82522]: No targets found.
Apr 17 10:55:26 user nova-compute[82522]: iSNS:
Apr 17 10:55:26 user nova-compute[82522]: No targets found.
Apr 17 10:55:26 user nova-compute[82522]: STATIC:
Apr 17 10:55:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9
Apr 17 10:55:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:55:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:55:26 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702
Apr 17 10:55:26 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:55:26 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:55:26 user nova-compute[82522]: FIRMWARE:
Apr 17 10:55:26 user nova-compute[82522]: No targets found.
Apr 17 10:55:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:55:26 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:55:26 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be4f595-6c61-424f-8df8-cdb6fa8383d2', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0651b8d4-a888-4554-9802-a9e3c3250d99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a785f-0c3f-4542-9e0f-3a817a526d9e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:55:26 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:55:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:55:26 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:55:26 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28437e710>, {}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Disconnecting from: [] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] <== disconnect_volume: return (67ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:55:26 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Deleting instance files /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7_del
Apr 17 10:55:26 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Deletion of /opt/stack/data/nova/instances/0deb56c2-1224-488f-9d30-4082ec677dc7_del complete
Apr 17 10:55:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 10:55:26 user nova-compute[82522]: INFO nova.compute.manager [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Took 0.73 seconds to destroy the instance on the hypervisor.
Apr 17 10:55:26 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:55:26 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:55:26 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Took 0.57 seconds to deallocate network for instance.
Apr 17 10:55:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received event network-vif-deleted-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:55:26 user nova-compute[82522]: INFO nova.compute.manager [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Neutron deleted interface 0464e1cc-c5eb-4e76-be88-393898a80f3b; detaching it from the instance and deleting it from the info cache
Apr 17 10:55:26 user nova-compute[82522]: DEBUG nova.network.neutron [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:55:26 user nova-compute[82522]: WARNING nova.volume.cinder [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Attachment aa20c97c-016c-4586-8c60-f09ff319f1db does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = aa20c97c-016c-4586-8c60-f09ff319f1db. (HTTP 404) (Request-ID: req-346ca7b6-4095-4814-ac67-8ecbd01a9c3a)
Apr 17 10:55:26 user nova-compute[82522]: INFO nova.compute.manager [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Took 0.02 seconds to detach 1 volumes for instance.
Apr 17 10:55:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG nova.compute.manager [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Detach interface failed, port_id=0464e1cc-c5eb-4e76-be88-393898a80f3b, reason: Instance 0deb56c2-1224-488f-9d30-4082ec677dc7 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:27 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Deleted allocations for instance 0deb56c2-1224-488f-9d30-4082ec677dc7
Apr 17 10:55:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.965s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG nova.compute.manager [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received event network-vif-plugged-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] Acquiring lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] Lock "0deb56c2-1224-488f-9d30-4082ec677dc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:27 user nova-compute[82522]: DEBUG nova.compute.manager [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] No waiting events found dispatching network-vif-plugged-0464e1cc-c5eb-4e76-be88-393898a80f3b {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:55:27 user nova-compute[82522]: WARNING nova.compute.manager [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Received unexpected event network-vif-plugged-0464e1cc-c5eb-4e76-be88-393898a80f3b for instance with vm_state deleted and task_state None.
Apr 17 10:55:29 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:29 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:32 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:55:32 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=26.34160614013672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Applying migration context for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 as it has an incoming, in-progress migration 07da10a1-8830-4111-8135-03611084669d. Migration status is finished {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 17 10:55:32 user nova-compute[82522]: INFO nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating resource usage from migration 07da10a1-8830-4111-8135-03611084669d
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Migration 07da10a1-8830-4111-8135-03611084669d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance bb68ad13-6870-417f-8593-4d41724109f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:55:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:33 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 10:55:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:55:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:55:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:55:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:40 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681728925.9462252, 0deb56c2-1224-488f-9d30-4082ec677dc7 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:55:40 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] VM Stopped (Lifecycle Event)
Apr 17 10:55:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-358b9142-a510-48c8-b724-87370a1c411f None None] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:55:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:55:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:55:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:55:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:55:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:55:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:55:50 user nova-compute[82522]: INFO nova.compute.claims [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Claim successful on node user
Apr 17 10:55:50 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:55:50 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:55:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:55:50 user nova-compute[82522]: INFO nova.virt.block_device [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Booting with volume snapshot 8e89f1cf-8496-4d63-b6a5-f70ee50ec102 at /dev/vda
Apr 17 10:55:50 user nova-compute[82522]: DEBUG nova.policy [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:55:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:51 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Successfully created port: ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Successfully updated port: ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "refresh_cache-c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquired lock "refresh_cache-c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received event network-changed-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Refreshing instance network info cache due to event network-changed-ff468c15-f042-4b7c-8f06-903bb2b72b09. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] Acquiring lock "refresh_cache-c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Updating instance_info_cache with network_info: [{"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Releasing lock "refresh_cache-c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Instance network_info: |[{"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] Acquired lock "refresh_cache-c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:55:52 user nova-compute[82522]: DEBUG nova.network.neutron [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Refreshing network info cache for port ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:55:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Updated VIF entry in instance network info cache for port ff468c15-f042-4b7c-8f06-903bb2b72b09. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:55:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Updating instance_info_cache with network_info: [{"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:55:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] Releasing lock "refresh_cache-c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:55:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG os_brick.utils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[204c4596-f96e-43a4-a0f1-55edf185d820]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[83625b00-fbfe-4b90-897a-feca2cfaf7d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3178f6e7-574d-43d8-9cec-8a9538d7f971]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb3ae73-03e3-4cb3-b3b5-c6cb3a71de43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:55:56 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:55:56 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3dc923-e22e-4a64-bc5e-5300d184808c]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG os_brick.utils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:55:56 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Updating existing volume attachment record: 474b04e3-c331-4969-a06a-480311e150c4 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:55:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:55:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:55:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:55:59 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:56:00 user nova-compute[82522]: INFO nova.compute.claims [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Claim successful on node user
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "385a180f-e722-4826-a6e0-47608461e66e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:56:00 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:56:00 user nova-compute[82522]: INFO nova.compute.claims [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Claim successful on node user
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.policy [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:56:00 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Creating image(s)
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk 1073741824" returned: 0 in 0.063s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:56:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Creating image(s)
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Ensure instance console log exists: /opt/stack/data/nova/instances/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Start _get_guest_xml network_info=[{"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-17T10:55:45Z,direct_url=<?>,disk_format='qcow2',id=b05ec620-79c7-4f27-9579-bd293b9a2783,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-614101046',owner='4fc3b8e3925847d48b522206a8875d3f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-17T10:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '474b04e3-c331-4969-a06a-480311e150c4', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRcCAXKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0be0db8-2b49-43f1-8f6f-0f3c2d73e647', 'attached_at': '', 'detached_at': '', 'volume_id': '5848cb56-e482-431a-a34e-3cb61920968e', 'serial': '5848cb56-e482-431a-a34e-3cb61920968e'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:56:01 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:01 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-17T10:55:45Z,direct_url=<?>,disk_format='qcow2',id=b05ec620-79c7-4f27-9579-bd293b9a2783,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-614101046',owner='4fc3b8e3925847d48b522206a8875d3f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-17T10:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRcCAXKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:56:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:56:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:56:01 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c316551c-d3e6-41b5-bc95-ccbab66d654a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:56:01 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[765770bb-1226-4019-8db5-b94dbe09357b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e] added
Apr 17 10:56:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:56:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Creating image(s)
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.policy [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[29686221-fb9f-4d69-a936-290a1332aaee]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Successfully created port: 9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[516251f2-58a0-4d53-a14c-b7fa3b5ada2d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRcCAXKi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Cannot resize image /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'migration_context' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRcCAXKi" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2fdcdf-d7b0-476a-ae38-074910d9f7d0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NRcCAXKi'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Ensure instance console log exists: /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5393a96-476d-4d8a-b403-17bb88167a38]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aa148e-2fae-4521-89de-0bcc5f41dd61]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:01 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:01 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ad008b-373e-4c6d-8693-7e5d7e54bfd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e, portal: 172.16.0.220,3260]
Apr 17 10:56:01 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e, portal: 172.16.0.220,3260] successful.
Apr 17 10:56:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed71e69-c50a-4b07-8d02-3b2297a946cd]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3fca9a-bc67-48a0-b590-cdcf34c08b45]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:01 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:01 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:01 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:01 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk 1073741824" returned: 0 in 0.053s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[75be04ba-c1da-4824-b50f-2f087cd93ef5]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRcCAXKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:56:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Cannot resize image /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'migration_context' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Ensure instance console log exists: /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Successfully updated port: 9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquired lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Successfully created port: 8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-changed-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Refreshing instance network info cache due to event network-changed-9c6c71a5-0190-4112-9044-5c238344dc88. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] Acquiring lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23135366339336133', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135366339336133', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1228801841',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1228801841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1228801841',id=33,image_ref='b05ec620-79c7-4f27-9579-bd293b9a2783',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-ai3stj5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1777404437',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:55:51Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=c0be0db8-2b49-43f1-8f6f-0f3c2d73e647,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:35:41,bridge_name='br-int',has_traffic_filtering=True,id=ff468c15-f042-4b7c-8f06-903bb2b72b09,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff468c15-f0') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.objects.instance [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'pci_devices' on Instance uuid c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:56:02 user nova-compute[82522]:   <uuid>c0be0db8-2b49-43f1-8f6f-0f3c2d73e647</uuid>
Apr 17 10:56:02 user nova-compute[82522]:   <name>instance-00000021</name>
Apr 17 10:56:02 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:56:02 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:56:02 user nova-compute[82522]:   <metadata>
Apr 17 10:56:02 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:56:02 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:56:02 user nova-compute[82522]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1228801841</nova:name>
Apr 17 10:56:02 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:56:01</nova:creationTime>
Apr 17 10:56:02 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:56:02 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:56:02 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:56:02 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:56:02 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:56:02 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:56:02 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:56:02 user nova-compute[82522]:       <nova:owner>
Apr 17 10:56:02 user nova-compute[82522]:         <nova:user uuid="0e4ed1192974484bba2d4392f4d011c2">tempest-TestVolumeBootPattern-1777404437-project-member</nova:user>
Apr 17 10:56:02 user nova-compute[82522]:         <nova:project uuid="4fc3b8e3925847d48b522206a8875d3f">tempest-TestVolumeBootPattern-1777404437</nova:project>
Apr 17 10:56:02 user nova-compute[82522]:       </nova:owner>
Apr 17 10:56:02 user nova-compute[82522]:       <nova:root type="image" uuid="b05ec620-79c7-4f27-9579-bd293b9a2783"/>
Apr 17 10:56:02 user nova-compute[82522]:       <nova:ports>
Apr 17 10:56:02 user nova-compute[82522]:         <nova:port uuid="ff468c15-f042-4b7c-8f06-903bb2b72b09">
Apr 17 10:56:02 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:56:02 user nova-compute[82522]:         </nova:port>
Apr 17 10:56:02 user nova-compute[82522]:       </nova:ports>
Apr 17 10:56:02 user nova-compute[82522]:     </nova:instance>
Apr 17 10:56:02 user nova-compute[82522]:   </metadata>
Apr 17 10:56:02 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:56:02 user nova-compute[82522]:     <system>
Apr 17 10:56:02 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:56:02 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:56:02 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:56:02 user nova-compute[82522]:       <entry name="serial">c0be0db8-2b49-43f1-8f6f-0f3c2d73e647</entry>
Apr 17 10:56:02 user nova-compute[82522]:       <entry name="uuid">c0be0db8-2b49-43f1-8f6f-0f3c2d73e647</entry>
Apr 17 10:56:02 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:56:02 user nova-compute[82522]:     </system>
Apr 17 10:56:02 user nova-compute[82522]:   </sysinfo>
Apr 17 10:56:02 user nova-compute[82522]:   <os>
Apr 17 10:56:02 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:56:02 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:56:02 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:56:02 user nova-compute[82522]:   </os>
Apr 17 10:56:02 user nova-compute[82522]:   <features>
Apr 17 10:56:02 user nova-compute[82522]:     <acpi/>
Apr 17 10:56:02 user nova-compute[82522]:     <apic/>
Apr 17 10:56:02 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:56:02 user nova-compute[82522]:   </features>
Apr 17 10:56:02 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:56:02 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:56:02 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:56:02 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:56:02 user nova-compute[82522]:   </clock>
Apr 17 10:56:02 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:56:02 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:56:02 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:56:02 user nova-compute[82522]:   </cpu>
Apr 17 10:56:02 user nova-compute[82522]:   <devices>
Apr 17 10:56:02 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:56:02 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:56:02 user nova-compute[82522]:       <source dev="/dev/sdd"/>
Apr 17 10:56:02 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:56:02 user nova-compute[82522]:       <serial>5848cb56-e482-431a-a34e-3cb61920968e</serial>
Apr 17 10:56:02 user nova-compute[82522]:     </disk>
Apr 17 10:56:02 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:56:02 user nova-compute[82522]:       <mac address="fa:16:3e:00:35:41"/>
Apr 17 10:56:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:56:02 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:56:02 user nova-compute[82522]:       <target dev="tapff468c15-f0"/>
Apr 17 10:56:02 user nova-compute[82522]:     </interface>
Apr 17 10:56:02 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:56:02 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647/console.log" append="off"/>
Apr 17 10:56:02 user nova-compute[82522]:     </serial>
Apr 17 10:56:02 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:56:02 user nova-compute[82522]:     <video>
Apr 17 10:56:02 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:56:02 user nova-compute[82522]:     </video>
Apr 17 10:56:02 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:56:02 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:56:02 user nova-compute[82522]:     </rng>
Apr 17 10:56:02 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:56:02 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:56:02 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:56:02 user nova-compute[82522]:     </memballoon>
Apr 17 10:56:02 user nova-compute[82522]:   </devices>
Apr 17 10:56:02 user nova-compute[82522]: </domain>
Apr 17 10:56:02 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1228801841',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1228801841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1228801841',id=33,image_ref='b05ec620-79c7-4f27-9579-bd293b9a2783',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-ai3stj5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1777404437',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:55:51Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=c0be0db8-2b49-43f1-8f6f-0f3c2d73e647,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:35:41,bridge_name='br-int',has_traffic_filtering=True,id=ff468c15-f042-4b7c-8f06-903bb2b72b09,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff468c15-f0') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG os_vif [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:35:41,bridge_name='br-int',has_traffic_filtering=True,id=ff468c15-f042-4b7c-8f06-903bb2b72b09,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff468c15-f0') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff468c15-f0, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff468c15-f0, col_values=(('external_ids', {'iface-id': 'ff468c15-f042-4b7c-8f06-903bb2b72b09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:35:41', 'vm-uuid': 'c0be0db8-2b49-43f1-8f6f-0f3c2d73e647'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:02 user nova-compute[82522]: INFO os_vif [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:35:41,bridge_name='br-int',has_traffic_filtering=True,id=ff468c15-f042-4b7c-8f06-903bb2b72b09,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff468c15-f0')
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:56:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No VIF found with MAC fa:16:3e:00:35:41, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.network.neutron [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Releasing lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Instance network_info: |[{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] Acquired lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.network.neutron [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Refreshing network info cache for port 9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Start _get_guest_xml network_info=[{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:56:03 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:03 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:55:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1021874936',display_name='tempest-ServerRescueNegativeTestJSON-server-1021874936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1021874936',id=34,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-w9lehq7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:56:01Z,user_data=None,user_id='30c15ce534a649ae8a971b33221e2500',uuid=06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c6c71a5-0190-4112-9044-5c238344dc88,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6c71a5-01') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'pci_devices' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:56:03 user nova-compute[82522]:   <uuid>06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f</uuid>
Apr 17 10:56:03 user nova-compute[82522]:   <name>instance-00000022</name>
Apr 17 10:56:03 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:56:03 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:56:03 user nova-compute[82522]:   <metadata>
Apr 17 10:56:03 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:56:03 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:56:03 user nova-compute[82522]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1021874936</nova:name>
Apr 17 10:56:03 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:56:03</nova:creationTime>
Apr 17 10:56:03 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:56:03 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:56:03 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:56:03 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:56:03 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:56:03 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:56:03 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:56:03 user nova-compute[82522]:       <nova:owner>
Apr 17 10:56:03 user nova-compute[82522]:         <nova:user uuid="30c15ce534a649ae8a971b33221e2500">tempest-ServerRescueNegativeTestJSON-1988041396-project-member</nova:user>
Apr 17 10:56:03 user nova-compute[82522]:         <nova:project uuid="3747b7d3c6844772b0e6eed5299053ba">tempest-ServerRescueNegativeTestJSON-1988041396</nova:project>
Apr 17 10:56:03 user nova-compute[82522]:       </nova:owner>
Apr 17 10:56:03 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:56:03 user nova-compute[82522]:       <nova:ports>
Apr 17 10:56:03 user nova-compute[82522]:         <nova:port uuid="9c6c71a5-0190-4112-9044-5c238344dc88">
Apr 17 10:56:03 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 10:56:03 user nova-compute[82522]:         </nova:port>
Apr 17 10:56:03 user nova-compute[82522]:       </nova:ports>
Apr 17 10:56:03 user nova-compute[82522]:     </nova:instance>
Apr 17 10:56:03 user nova-compute[82522]:   </metadata>
Apr 17 10:56:03 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:56:03 user nova-compute[82522]:     <system>
Apr 17 10:56:03 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:56:03 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:56:03 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:56:03 user nova-compute[82522]:       <entry name="serial">06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f</entry>
Apr 17 10:56:03 user nova-compute[82522]:       <entry name="uuid">06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f</entry>
Apr 17 10:56:03 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:56:03 user nova-compute[82522]:     </system>
Apr 17 10:56:03 user nova-compute[82522]:   </sysinfo>
Apr 17 10:56:03 user nova-compute[82522]:   <os>
Apr 17 10:56:03 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:56:03 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:56:03 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:56:03 user nova-compute[82522]:   </os>
Apr 17 10:56:03 user nova-compute[82522]:   <features>
Apr 17 10:56:03 user nova-compute[82522]:     <acpi/>
Apr 17 10:56:03 user nova-compute[82522]:     <apic/>
Apr 17 10:56:03 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:56:03 user nova-compute[82522]:   </features>
Apr 17 10:56:03 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:56:03 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:56:03 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:56:03 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:56:03 user nova-compute[82522]:   </clock>
Apr 17 10:56:03 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:56:03 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:56:03 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:56:03 user nova-compute[82522]:   </cpu>
Apr 17 10:56:03 user nova-compute[82522]:   <devices>
Apr 17 10:56:03 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:56:03 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:56:03 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk"/>
Apr 17 10:56:03 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:56:03 user nova-compute[82522]:     </disk>
Apr 17 10:56:03 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:56:03 user nova-compute[82522]:       <mac address="fa:16:3e:07:47:fb"/>
Apr 17 10:56:03 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:56:03 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:56:03 user nova-compute[82522]:       <target dev="tap9c6c71a5-01"/>
Apr 17 10:56:03 user nova-compute[82522]:     </interface>
Apr 17 10:56:03 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:56:03 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/console.log" append="off"/>
Apr 17 10:56:03 user nova-compute[82522]:     </serial>
Apr 17 10:56:03 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:56:03 user nova-compute[82522]:     <video>
Apr 17 10:56:03 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:56:03 user nova-compute[82522]:     </video>
Apr 17 10:56:03 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:56:03 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:56:03 user nova-compute[82522]:     </rng>
Apr 17 10:56:03 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:56:03 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:56:03 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:56:03 user nova-compute[82522]:     </memballoon>
Apr 17 10:56:03 user nova-compute[82522]:   </devices>
Apr 17 10:56:03 user nova-compute[82522]: </domain>
Apr 17 10:56:03 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:55:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1021874936',display_name='tempest-ServerRescueNegativeTestJSON-server-1021874936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1021874936',id=34,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-w9lehq7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:56:01Z,user_data=None,user_id='30c15ce534a649ae8a971b33221e2500',uuid=06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c6c71a5-0190-4112-9044-5c238344dc88,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6c71a5-01') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG os_vif [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c6c71a5-0190-4112-9044-5c238344dc88,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6c71a5-01') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c6c71a5-01, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c6c71a5-01, col_values=(('external_ids', {'iface-id': '9c6c71a5-0190-4112-9044-5c238344dc88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:47:fb', 'vm-uuid': '06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:03 user nova-compute[82522]: INFO os_vif [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c6c71a5-0190-4112-9044-5c238344dc88,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6c71a5-01')
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:56:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No VIF found with MAC fa:16:3e:07:47:fb, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.neutron [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updated VIF entry in instance network info cache for port 9c6c71a5-0190-4112-9044-5c238344dc88. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.neutron [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] Releasing lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Successfully updated port: 8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquired lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updating instance_info_cache with network_info: [{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Releasing lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Instance network_info: |[{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Start _get_guest_xml network_info=[{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:56:04 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:04 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1439667505',display_name='tempest-ServerRescueNegativeTestJSON-server-1439667505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1439667505',id=35,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-kyumsi6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:56:01Z,user_data=None,user_id='30c15ce534a649ae8a971b33221e2500',uuid=385a180f-e722-4826-a6e0-47608461e66e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:de:f3,bridge_name='br-int',has_traffic_filtering=True,id=8fca060e-eb45-4132-9515-99574c15e1a0,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fca060e-eb') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'pci_devices' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:56:04 user nova-compute[82522]:   <uuid>385a180f-e722-4826-a6e0-47608461e66e</uuid>
Apr 17 10:56:04 user nova-compute[82522]:   <name>instance-00000023</name>
Apr 17 10:56:04 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:56:04 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:56:04 user nova-compute[82522]:   <metadata>
Apr 17 10:56:04 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:56:04 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:56:04 user nova-compute[82522]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1439667505</nova:name>
Apr 17 10:56:04 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:56:04</nova:creationTime>
Apr 17 10:56:04 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:56:04 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:56:04 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:56:04 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:56:04 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:56:04 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:56:04 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:56:04 user nova-compute[82522]:       <nova:owner>
Apr 17 10:56:04 user nova-compute[82522]:         <nova:user uuid="30c15ce534a649ae8a971b33221e2500">tempest-ServerRescueNegativeTestJSON-1988041396-project-member</nova:user>
Apr 17 10:56:04 user nova-compute[82522]:         <nova:project uuid="3747b7d3c6844772b0e6eed5299053ba">tempest-ServerRescueNegativeTestJSON-1988041396</nova:project>
Apr 17 10:56:04 user nova-compute[82522]:       </nova:owner>
Apr 17 10:56:04 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:56:04 user nova-compute[82522]:       <nova:ports>
Apr 17 10:56:04 user nova-compute[82522]:         <nova:port uuid="8fca060e-eb45-4132-9515-99574c15e1a0">
Apr 17 10:56:04 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 10:56:04 user nova-compute[82522]:         </nova:port>
Apr 17 10:56:04 user nova-compute[82522]:       </nova:ports>
Apr 17 10:56:04 user nova-compute[82522]:     </nova:instance>
Apr 17 10:56:04 user nova-compute[82522]:   </metadata>
Apr 17 10:56:04 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:56:04 user nova-compute[82522]:     <system>
Apr 17 10:56:04 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:56:04 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:56:04 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:56:04 user nova-compute[82522]:       <entry name="serial">385a180f-e722-4826-a6e0-47608461e66e</entry>
Apr 17 10:56:04 user nova-compute[82522]:       <entry name="uuid">385a180f-e722-4826-a6e0-47608461e66e</entry>
Apr 17 10:56:04 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:56:04 user nova-compute[82522]:     </system>
Apr 17 10:56:04 user nova-compute[82522]:   </sysinfo>
Apr 17 10:56:04 user nova-compute[82522]:   <os>
Apr 17 10:56:04 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:56:04 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:56:04 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:56:04 user nova-compute[82522]:   </os>
Apr 17 10:56:04 user nova-compute[82522]:   <features>
Apr 17 10:56:04 user nova-compute[82522]:     <acpi/>
Apr 17 10:56:04 user nova-compute[82522]:     <apic/>
Apr 17 10:56:04 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:56:04 user nova-compute[82522]:   </features>
Apr 17 10:56:04 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:56:04 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:56:04 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:56:04 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:56:04 user nova-compute[82522]:   </clock>
Apr 17 10:56:04 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:56:04 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:56:04 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:56:04 user nova-compute[82522]:   </cpu>
Apr 17 10:56:04 user nova-compute[82522]:   <devices>
Apr 17 10:56:04 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:56:04 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:56:04 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk"/>
Apr 17 10:56:04 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:56:04 user nova-compute[82522]:     </disk>
Apr 17 10:56:04 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:56:04 user nova-compute[82522]:       <mac address="fa:16:3e:b7:de:f3"/>
Apr 17 10:56:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:56:04 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:56:04 user nova-compute[82522]:       <target dev="tap8fca060e-eb"/>
Apr 17 10:56:04 user nova-compute[82522]:     </interface>
Apr 17 10:56:04 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:56:04 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/console.log" append="off"/>
Apr 17 10:56:04 user nova-compute[82522]:     </serial>
Apr 17 10:56:04 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:56:04 user nova-compute[82522]:     <video>
Apr 17 10:56:04 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:56:04 user nova-compute[82522]:     </video>
Apr 17 10:56:04 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:56:04 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:56:04 user nova-compute[82522]:     </rng>
Apr 17 10:56:04 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:56:04 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:56:04 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:56:04 user nova-compute[82522]:     </memballoon>
Apr 17 10:56:04 user nova-compute[82522]:   </devices>
Apr 17 10:56:04 user nova-compute[82522]: </domain>
Apr 17 10:56:04 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1439667505',display_name='tempest-ServerRescueNegativeTestJSON-server-1439667505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1439667505',id=35,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-kyumsi6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:56:01Z,user_data=None,user_id='30c15ce534a649ae8a971b33221e2500',uuid=385a180f-e722-4826-a6e0-47608461e66e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:de:f3,bridge_name='br-int',has_traffic_filtering=True,id=8fca060e-eb45-4132-9515-99574c15e1a0,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fca060e-eb') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG os_vif [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:de:f3,bridge_name='br-int',has_traffic_filtering=True,id=8fca060e-eb45-4132-9515-99574c15e1a0,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fca060e-eb') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fca060e-eb, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fca060e-eb, col_values=(('external_ids', {'iface-id': '8fca060e-eb45-4132-9515-99574c15e1a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:de:f3', 'vm-uuid': '385a180f-e722-4826-a6e0-47608461e66e'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:04 user nova-compute[82522]: INFO os_vif [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:de:f3,bridge_name='br-int',has_traffic_filtering=True,id=8fca060e-eb45-4132-9515-99574c15e1a0,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fca060e-eb')
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No VIF found with MAC fa:16:3e:b7:de:f3, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-changed-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Refreshing instance network info cache due to event network-changed-8fca060e-eb45-4132-9515-99574c15e1a0. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] Acquiring lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] Acquired lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:04 user nova-compute[82522]: DEBUG nova.network.neutron [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Refreshing network info cache for port 8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG nova.network.neutron [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updated VIF entry in instance network info cache for port 8fca060e-eb45-4132-9515-99574c15e1a0. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG nova.network.neutron [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updating instance_info_cache with network_info: [{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] Releasing lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received event network-vif-plugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] Acquiring lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] No waiting events found dispatching network-vif-plugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:05 user nova-compute[82522]: WARNING nova.compute.manager [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received unexpected event network-vif-plugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance with vm_state building and task_state spawning.
Apr 17 10:56:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Port 67386c8f-911d-4398-b449-42af25f6afe3 binding to destination host user is already ACTIVE {{(pid=82522) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received event network-vif-plugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Acquiring lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] No waiting events found dispatching network-vif-plugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:07 user nova-compute[82522]: WARNING nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received unexpected event network-vif-plugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance with vm_state building and task_state spawning.
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:07 user nova-compute[82522]: WARNING nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state building and task_state spawning.
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:07 user nova-compute[82522]: WARNING nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state building and task_state spawning.
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] No waiting events found dispatching network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:07 user nova-compute[82522]: WARNING nova.compute.manager [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received unexpected event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 for instance with vm_state building and task_state spawning.
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.network.neutron [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Creating tmpfile /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/tmpw0odk1dk to verify with other compute node that the instance is on the same shared storage. {{(pid=82522) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:08 user nova-compute[82522]: WARNING nova.compute.manager [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state resized and task_state resize_reverting.
Apr 17 10:56:08 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance destroyed successfully.
Apr 17 10:56:08 user nova-compute[82522]: DEBUG nova.objects.instance [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'resources' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_vif [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67386c8f-91, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:56:08 user nova-compute[82522]: INFO os_vif [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91')
Apr 17 10:56:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:56:08 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f38bc4c-1dd4-4a2f-962c-f2b8b4118b85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:56:08 user nova-compute[82522]: No targets found.
Apr 17 10:56:08 user nova-compute[82522]: iSNS:
Apr 17 10:56:08 user nova-compute[82522]: No targets found.
Apr 17 10:56:08 user nova-compute[82522]: STATIC:
Apr 17 10:56:08 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9
Apr 17 10:56:08 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:56:08 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:56:08 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e
Apr 17 10:56:08 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:56:08 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:56:08 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702
Apr 17 10:56:08 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:56:08 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:56:08 user nova-compute[82522]: FIRMWARE:
Apr 17 10:56:08 user nova-compute[82522]: No targets found.
Apr 17 10:56:08 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:56:08 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:56:08 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da36cd6-d371-41e4-9c55-fa2b3a5a82d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5fd479-2d01-472e-aad6-0fd6a19f162d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:08 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:08 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:08 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:08 user nova-compute[82522]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:08 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:08 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7de7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12b6e92-33ca-4eb7-bac2-76f899ea5009]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8114f4d-b6a1-4582-aa8b-b6e33914911b]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6070e754-6ba1-4250-9868-c2283e40d37b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218970d-5bc3-4748-a265-bd7d63671619]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3fa96e-2b98-4d1d-a667-8799bc1ac550]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd1abd-3ea0-499e-85f4-c9ef2db0b062]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]
Apr 17 10:56:08 user nova-compute[82522]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.
Apr 17 10:56:08 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a9a34c-21d5-4e77-a070-20a54a080311]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== disconnect_volume: return (327ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:56:08 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728969.0965965, c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] VM Resumed (Lifecycle Event)
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Instance spawned successfully.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728969.0992525, c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] VM Started (Lifecycle Event)
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Took 7.94 seconds to spawn the instance on the hypervisor.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Took 19.12 seconds to build instance.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.240s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728969.468503, 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] VM Resumed (Lifecycle Event)
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Instance spawned successfully.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728969.469503, 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] VM Started (Lifecycle Event)
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Instance spawned successfully.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Took 8.74 seconds to spawn the instance on the hypervisor.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728969.5688977, 385a180f-e722-4826-a6e0-47608461e66e => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] VM Resumed (Lifecycle Event)
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728969.5693882, 385a180f-e722-4826-a6e0-47608461e66e => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] VM Started (Lifecycle Event)
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Took 9.63 seconds to build instance.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.772s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Took 8.34 seconds to spawn the instance on the hypervisor.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] No waiting events found dispatching network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:09 user nova-compute[82522]: WARNING nova.compute.manager [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received unexpected event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 for instance with vm_state building and task_state spawning.
Apr 17 10:56:09 user nova-compute[82522]: INFO nova.compute.manager [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Took 9.21 seconds to build instance.
Apr 17 10:56:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "385a180f-e722-4826-a6e0-47608461e66e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.355s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG nova.objects.instance [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'migration_context' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:10 user nova-compute[82522]: WARNING nova.compute.manager [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state resized and task_state resize_reverting.
Apr 17 10:56:10 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.365s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:10 user nova-compute[82522]: INFO nova.compute.manager [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Swapping old allocation on dict_keys(['152e783c-5f4a-4c29-a7c0-63b63ff61fda']) held by migration 07da10a1-8830-4111-8135-03611084669d for instance
Apr 17 10:56:10 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Overwriting current allocation {'allocations': {'152e783c-5f4a-4c29-a7c0-63b63ff61fda': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 42}}, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'consumer_generation': 1} on consumer 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:10 user nova-compute[82522]: DEBUG nova.network.neutron [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG nova.network.neutron [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG os_brick.utils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c75d64-ac10-4708-bdf2-ca9f8e470b7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4a6950-c3ee-4fa8-9ba3-13b82d7d0847]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[292707a8-02e9-42c3-b9df-023405c50270]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ed259b-33f5-415b-8ab0-33417033b48f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:56:11 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:56:11 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93e57ef-ae29-4096-bcdf-cb4843639d5c]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:56:11 user nova-compute[82522]: DEBUG os_brick.utils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:56:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Starting finish_revert_migration {{(pid=82522) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Start _get_guest_xml network_info=[{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '3556b355-0922-4167-ad3a-ba4a14e7da7a', 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38', 'attached_at': '2023-04-17T10:56:16.000000', 'detached_at': '', 'volume_id': '38ad981a-53cd-46a2-825a-78feacd3c702', 'serial': '38ad981a-53cd-46a2-825a-78feacd3c702'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:56:16 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:16 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.objects.instance [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:56:16 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:56:16 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:56:16 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c518b568-913b-48cb-8e78-67f9a38f335c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:56:16 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[00253396-9757-46b6-93ca-1bb11b48022f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702] added
Apr 17 10:56:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e2648c-79af-4b97-89b5-722fcb617121]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e051e69d-9d59-4260-8bd5-fd94f767a340]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v womeMVRZ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v womeMVRZ" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[af70ce95-fa27-4a8f-b824-89d480fb1efd]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'womeMVRZ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[72389f3d-5380-4802-b79f-944e4214e47c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13e371e-2596-42b7-85f0-de53799f7532]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:16 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:16 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e06cb-2626-4e93-a491-8c5862a29f73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]
Apr 17 10:56:16 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.
Apr 17 10:56:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b876473-6818-4735-b493-36eb464c5335]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9467e1-79d7-49b9-9d21-438d8a881b52]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:16 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:16 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:16 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:16 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:16 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c0ab09-d23d-4466-a67a-ada4183a88c5]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:56:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23462616433623138', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462616433623138', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:56:18 user nova-compute[82522]:   <uuid>2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</uuid>
Apr 17 10:56:18 user nova-compute[82522]:   <name>instance-00000018</name>
Apr 17 10:56:18 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:56:18 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:56:18 user nova-compute[82522]:   <metadata>
Apr 17 10:56:18 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:56:18 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:56:18 user nova-compute[82522]:       <nova:name>tempest-ServerActionsTestJSON-server-1036404855</nova:name>
Apr 17 10:56:18 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:56:16</nova:creationTime>
Apr 17 10:56:18 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:56:18 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:56:18 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:56:18 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:56:18 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:56:18 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:56:18 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:56:18 user nova-compute[82522]:       <nova:owner>
Apr 17 10:56:18 user nova-compute[82522]:         <nova:user uuid="a7e218d771db49e88d13d3b088f3d88a">tempest-ServerActionsTestJSON-2107442540-project-member</nova:user>
Apr 17 10:56:18 user nova-compute[82522]:         <nova:project uuid="cc1b39ff9581474b87c58164e5cafa00">tempest-ServerActionsTestJSON-2107442540</nova:project>
Apr 17 10:56:18 user nova-compute[82522]:       </nova:owner>
Apr 17 10:56:18 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:56:18 user nova-compute[82522]:       <nova:ports>
Apr 17 10:56:18 user nova-compute[82522]:         <nova:port uuid="67386c8f-911d-4398-b449-42af25f6afe3">
Apr 17 10:56:18 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 10:56:18 user nova-compute[82522]:         </nova:port>
Apr 17 10:56:18 user nova-compute[82522]:       </nova:ports>
Apr 17 10:56:18 user nova-compute[82522]:     </nova:instance>
Apr 17 10:56:18 user nova-compute[82522]:   </metadata>
Apr 17 10:56:18 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:56:18 user nova-compute[82522]:     <system>
Apr 17 10:56:18 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:56:18 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:56:18 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:56:18 user nova-compute[82522]:       <entry name="serial">2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</entry>
Apr 17 10:56:18 user nova-compute[82522]:       <entry name="uuid">2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38</entry>
Apr 17 10:56:18 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:56:18 user nova-compute[82522]:     </system>
Apr 17 10:56:18 user nova-compute[82522]:   </sysinfo>
Apr 17 10:56:18 user nova-compute[82522]:   <os>
Apr 17 10:56:18 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:56:18 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:56:18 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:56:18 user nova-compute[82522]:   </os>
Apr 17 10:56:18 user nova-compute[82522]:   <features>
Apr 17 10:56:18 user nova-compute[82522]:     <acpi/>
Apr 17 10:56:18 user nova-compute[82522]:     <apic/>
Apr 17 10:56:18 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:56:18 user nova-compute[82522]:   </features>
Apr 17 10:56:18 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:56:18 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:56:18 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:56:18 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:56:18 user nova-compute[82522]:   </clock>
Apr 17 10:56:18 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:56:18 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:56:18 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:56:18 user nova-compute[82522]:   </cpu>
Apr 17 10:56:18 user nova-compute[82522]:   <devices>
Apr 17 10:56:18 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:56:18 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:56:18 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk"/>
Apr 17 10:56:18 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:56:18 user nova-compute[82522]:     </disk>
Apr 17 10:56:18 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:56:18 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:56:18 user nova-compute[82522]:       <source dev="/dev/sdb"/>
Apr 17 10:56:18 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:56:18 user nova-compute[82522]:       <serial>38ad981a-53cd-46a2-825a-78feacd3c702</serial>
Apr 17 10:56:18 user nova-compute[82522]:     </disk>
Apr 17 10:56:18 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:56:18 user nova-compute[82522]:       <mac address="fa:16:3e:d3:62:81"/>
Apr 17 10:56:18 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:56:18 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:56:18 user nova-compute[82522]:       <target dev="tap67386c8f-91"/>
Apr 17 10:56:18 user nova-compute[82522]:     </interface>
Apr 17 10:56:18 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:56:18 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/console.log" append="off"/>
Apr 17 10:56:18 user nova-compute[82522]:     </serial>
Apr 17 10:56:18 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:56:18 user nova-compute[82522]:     <video>
Apr 17 10:56:18 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:56:18 user nova-compute[82522]:     </video>
Apr 17 10:56:18 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:56:18 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:56:18 user nova-compute[82522]:     </rng>
Apr 17 10:56:18 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:56:18 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:56:18 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:56:18 user nova-compute[82522]:     </memballoon>
Apr 17 10:56:18 user nova-compute[82522]:   </devices>
Apr 17 10:56:18 user nova-compute[82522]: </domain>
Apr 17 10:56:18 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG os_vif [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67386c8f-91, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67386c8f-91, col_values=(('external_ids', {'iface-id': '67386c8f-911d-4398-b449-42af25f6afe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:62:81', 'vm-uuid': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:56:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:18 user nova-compute[82522]: INFO os_vif [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91')
Apr 17 10:56:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:19 user nova-compute[82522]: DEBUG nova.compute.manager [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:19 user nova-compute[82522]: DEBUG nova.compute.manager [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:19 user nova-compute[82522]: WARNING nova.compute.manager [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state resized and task_state resize_reverting.
Apr 17 10:56:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728981.7062328, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:21 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Resumed (Lifecycle Event)
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:56:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance running successfully.
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] finish_revert_migration finished successfully. {{(pid=82522) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:21 user nova-compute[82522]: WARNING nova.compute.manager [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state resized and task_state resize_reverting.
Apr 17 10:56:21 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681728981.707743, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:21 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Started (Lifecycle Event)
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:21 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 17 10:56:21 user nova-compute[82522]: INFO nova.compute.manager [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance to original state: 'active'
Apr 17 10:56:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:30 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'flavor' on Instance uuid bb68ad13-6870-417f-8593-4d41724109f4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:32 user nova-compute[82522]: INFO nova.compute.manager [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Attaching volume 8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 to /dev/vdb
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG os_brick.utils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff0001c-271b-4ed9-b404-40474ac66890]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[078bedd7-b7fa-4c58-ba1d-6b56a95c38f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7916b0e-2ed5-4df8-b539-1655a9729baf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d1aeb6-e2cf-4430-90b1-809afad603b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:56:32 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcda608c-3f35-473d-8181-b4e77dad67cb]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG os_brick.utils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating existing volume attachment record: 186668c6-ad11-4208-8680-22a5723050e9 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:56:33 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8034MB free_disk=26.316112518310547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance bb68ad13-6870-417f-8593-4d41724109f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:56:33 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:56:34 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:56:34 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:56:34 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:56:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:35 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:35 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNItcjxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:56:37 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:56:37 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:56:37 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[317c82d1-f609-4aa8-8d2a-e7ba42cc76eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:56:37 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[32018969-c1af-4cef-86c3-36e97ba1e55d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433] added
Apr 17 10:56:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d43997-495a-4703-91cc-379300bd4366]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[111c015f-0142-42df-810f-c6965249558d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNItcjxG {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNItcjxG" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[015fb0d6-a7a3-48fe-aa1f-b76b3db446e7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNItcjxG'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a714bf6d-889b-4395-99e1-5e8e62b3be1d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f770fec-6a13-417f-9f4b-941e83ef676c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d02f5d-5a73-4c46-af36-d981903d6140]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433, portal: 172.16.0.220,3260]
Apr 17 10:56:37 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433, portal: 172.16.0.220,3260] successful.
Apr 17 10:56:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27eff3e-fe3d-4ce0-b42a-56c137dc8db1]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aa7f29-ca1f-4f5f-9bf9-d5a89d9d5fef]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)
Apr 17 10:56:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29aadd1-6daf-42fd-9d9b-7488b7f3d31d]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:56:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNItcjxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-109ee5e0-8c02-43c2-9415-48bb0c8c3a06" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-109ee5e0-8c02-43c2-9415-48bb0c8c3a06" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Updating instance_info_cache with network_info: [{"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-109ee5e0-8c02-43c2-9415-48bb0c8c3a06" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23531633263353835', 'path': '/dev/sde'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531633263353835', 'path': '/dev/sde'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG nova.objects.instance [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'flavor' on Instance uuid bb68ad13-6870-417f-8593-4d41724109f4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:56:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 10:56:38 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:56:38 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:56:38 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:56:38 user nova-compute[82522]:   <serial>8c5f7bbd-005e-4a88-be2b-ff4f1cb86433</serial>
Apr 17 10:56:38 user nova-compute[82522]: </disk>
Apr 17 10:56:38 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 10:56:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:56:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:56:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:56:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] No VIF found with MAC fa:16:3e:1f:9c:b6, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:56:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.855s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing instance network info cache due to event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:56:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] Acquiring lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] Acquired lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:56:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updated VIF entry in instance network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:56:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating instance_info_cache with network_info: [{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] Releasing lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG nova.compute.manager [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing instance network info cache due to event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] Acquiring lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] Acquired lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:44 user nova-compute[82522]: INFO nova.compute.manager [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Rebooting instance
Apr 17 10:56:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updated VIF entry in instance network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG nova.network.neutron [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating instance_info_cache with network_info: [{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] Releasing lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquired lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:56:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:56:45 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:56:45 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating instance_info_cache with network_info: [{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:56:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Releasing lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:56:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-unplugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] No waiting events found dispatching network-vif-unplugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:48 user nova-compute[82522]: WARNING nova.compute.manager [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received unexpected event network-vif-unplugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance with vm_state active and task_state reboot_started.
Apr 17 10:56:48 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Instance shutdown successfully.
Apr 17 10:56:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG nova.compute.manager [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG nova.compute.manager [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] No waiting events found dispatching network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:50 user nova-compute[82522]: WARNING nova.compute.manager [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received unexpected event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance with vm_state active and task_state reboot_started.
Apr 17 10:56:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for bb68ad13-6870-417f-8593-4d41724109f4 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729012.2172108, bb68ad13-6870-417f-8593-4d41724109f4 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:52 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] VM Resumed (Lifecycle Event)
Apr 17 10:56:52 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Instance running successfully.
Apr 17 10:56:52 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Instance soft rebooted successfully.
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:52 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729012.2244802, bb68ad13-6870-417f-8593-4d41724109f4 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:56:52 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] VM Started (Lifecycle Event)
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.534s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] No waiting events found dispatching network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:52 user nova-compute[82522]: WARNING nova.compute.manager [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received unexpected event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance with vm_state active and task_state None.
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:56:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] No waiting events found dispatching network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:56:52 user nova-compute[82522]: WARNING nova.compute.manager [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received unexpected event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance with vm_state active and task_state None.
Apr 17 10:56:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:56:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:57:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:57:33 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:57:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:35 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:57:35 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:57:35 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8267MB free_disk=26.30475616455078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance bb68ad13-6870-417f-8593-4d41724109f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:57:35 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:57:36 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:57:36 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:57:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:57:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:37 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:57:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:57:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:57:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:57:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:40 user nova-compute[82522]: INFO nova.compute.manager [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Terminating instance
Apr 17 10:57:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received event network-vif-unplugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] Acquiring lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] No waiting events found dispatching network-vif-unplugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received event network-vif-unplugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating instance_info_cache with network_info: [{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Instance destroyed successfully.
Apr 17 10:57:41 user nova-compute[82522]: DEBUG nova.objects.instance [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'resources' on Instance uuid c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1228801841',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1228801841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1228801841',id=33,image_ref='b05ec620-79c7-4f27-9579-bd293b9a2783',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-ai3stj5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1777404437',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:56:09Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=c0be0db8-2b49-43f1-8f6f-0f3c2d73e647,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "address": "fa:16:3e:00:35:41", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff468c15-f0", "ovs_interfaceid": "ff468c15-f042-4b7c-8f06-903bb2b72b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:35:41,bridge_name='br-int',has_traffic_filtering=True,id=ff468c15-f042-4b7c-8f06-903bb2b72b09,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff468c15-f0') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_vif [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:35:41,bridge_name='br-int',has_traffic_filtering=True,id=ff468c15-f042-4b7c-8f06-903bb2b72b09,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff468c15-f0') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff468c15-f0, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:41 user nova-compute[82522]: INFO os_vif [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:35:41,bridge_name='br-int',has_traffic_filtering=True,id=ff468c15-f042-4b7c-8f06-903bb2b72b09,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff468c15-f0')
Apr 17 10:57:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRcCAXKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:57:41 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c826feb7-c1c8-4688-8091-3e20f7e0b236]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:57:41 user nova-compute[82522]: No targets found.
Apr 17 10:57:41 user nova-compute[82522]: iSNS:
Apr 17 10:57:41 user nova-compute[82522]: No targets found.
Apr 17 10:57:41 user nova-compute[82522]: STATIC:
Apr 17 10:57:41 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9
Apr 17 10:57:41 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:57:41 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:57:41 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e
Apr 17 10:57:41 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:57:41 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:57:41 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433
Apr 17 10:57:41 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:57:41 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:57:41 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702
Apr 17 10:57:41 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:57:41 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:57:41 user nova-compute[82522]: FIRMWARE:
Apr 17 10:57:41 user nova-compute[82522]: No targets found.
Apr 17 10:57:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:57:41 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:57:41 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0cac3-0ce1-4355-8492-74914a09ca12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde77f49-65f4-441f-9c40-93f7022e09f3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:57:41 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:57:41 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:57:41 user nova-compute[82522]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)
Apr 17 10:57:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:57:41 user nova-compute[82522]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e (non-flash)
Apr 17 10:57:41 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:57:41 user nova-compute[82522]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)
Apr 17 10:57:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7cdacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e'): ({'sdd'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Removing single pathed devices sdd {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e5904-d394-4974-b4dd-a7b8778d7b0d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ec8470-a763-4394-b7f8-955160ef7120]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flushing IO for device /dev/sdd {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb6ecf8-af8f-4693-8556-73b10dd37f8f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[048dedaf-f717-4a6a-9d4b-0eeeb0b3e28b]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23135366339336133', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_446e210a', '/dev/disk/by-id/scsi-1SCST_BIO446e210a-156c93a3a23b4741') {{(pid=92652) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cbbc63-8f84-405f-8620-1de0b5a6a8f0]: (4, None) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[100dd709-3a51-4685-bddf-e0166305784f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d61385-d7f7-434b-a3b9-d58f90422cf0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e, portal: 172.16.0.220,3260]
Apr 17 10:57:41 user nova-compute[82522]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e, portal: 172.16.0.220,3260] successful.
Apr 17 10:57:41 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5848cb56-e482-431a-a34e-3cb61920968e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bed6fe-6db9-4171-bd38-c8f911f568ee]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== disconnect_volume: return (347ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:57:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Deleting instance files /opt/stack/data/nova/instances/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647_del
Apr 17 10:57:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Deletion of /opt/stack/data/nova/instances/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647_del complete
Apr 17 10:57:41 user nova-compute[82522]: INFO nova.compute.manager [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 17 10:57:41 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:57:41 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:57:42 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:57:42 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Took 0.43 seconds to deallocate network for instance.
Apr 17 10:57:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received event network-vif-deleted-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:57:42 user nova-compute[82522]: INFO nova.compute.manager [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Neutron deleted interface ff468c15-f042-4b7c-8f06-903bb2b72b09; detaching it from the instance and deleting it from the info cache
Apr 17 10:57:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:57:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Detach interface failed, port_id=ff468c15-f042-4b7c-8f06-903bb2b72b09, reason: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 10:57:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received event network-vif-plugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:57:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] Acquiring lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] No waiting events found dispatching network-vif-plugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:57:42 user nova-compute[82522]: WARNING nova.compute.manager [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Received unexpected event network-vif-plugged-ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance with vm_state active and task_state deleting.
Apr 17 10:57:42 user nova-compute[82522]: INFO nova.compute.manager [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Took 0.78 seconds to detach 1 volumes for instance.
Apr 17 10:57:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Deleting volume: 5848cb56-e482-431a-a34e-3cb61920968e {{(pid=82522) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 17 10:57:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:43 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:57:43 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:57:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:43 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Deleted allocations for instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647
Apr 17 10:57:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.898s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:50 user nova-compute[82522]: INFO nova.compute.manager [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Rescuing
Apr 17 10:57:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:57:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquired lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:57:50 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG nova.network.neutron [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updating instance_info_cache with network_info: [{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Releasing lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-unplugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] No waiting events found dispatching network-vif-unplugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:57:51 user nova-compute[82522]: WARNING nova.compute.manager [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received unexpected event network-vif-unplugged-8fca060e-eb45-4132-9515-99574c15e1a0 for instance with vm_state active and task_state rescuing.
Apr 17 10:57:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Instance destroyed successfully.
Apr 17 10:57:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Attempting rescue
Apr 17 10:57:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82522) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Instance directory exists: not creating {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 10:57:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Creating image(s)
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'trusted_certs' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue" returned: 0 in 0.046s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'migration_context' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Start _get_guest_xml network_info=[{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "vif_mac": "fa:16:3e:b7:de:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '66764afd-311a-41a0-a068-b2937b23acba', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'resources' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'numa_topology' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:57:52 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:57:52 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'vcpu_model' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1439667505',display_name='tempest-ServerRescueNegativeTestJSON-server-1439667505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1439667505',id=35,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-kyumsi6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:56:10Z,user_data=None,user_id='30c15ce534a649ae8a971b33221e2500',uuid=385a180f-e722-4826-a6e0-47608461e66e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "vif_mac": "fa:16:3e:b7:de:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "vif_mac": "fa:16:3e:b7:de:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:de:f3,bridge_name='br-int',has_traffic_filtering=True,id=8fca060e-eb45-4132-9515-99574c15e1a0,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fca060e-eb') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'pci_devices' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:57:52 user nova-compute[82522]:   <uuid>385a180f-e722-4826-a6e0-47608461e66e</uuid>
Apr 17 10:57:52 user nova-compute[82522]:   <name>instance-00000023</name>
Apr 17 10:57:52 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:57:52 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:57:52 user nova-compute[82522]:   <metadata>
Apr 17 10:57:52 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:57:52 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:57:52 user nova-compute[82522]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1439667505</nova:name>
Apr 17 10:57:52 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:57:52</nova:creationTime>
Apr 17 10:57:52 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:57:52 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:57:52 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:57:52 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:57:52 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:57:52 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:57:52 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:57:52 user nova-compute[82522]:       <nova:owner>
Apr 17 10:57:52 user nova-compute[82522]:         <nova:user uuid="30c15ce534a649ae8a971b33221e2500">tempest-ServerRescueNegativeTestJSON-1988041396-project-member</nova:user>
Apr 17 10:57:52 user nova-compute[82522]:         <nova:project uuid="3747b7d3c6844772b0e6eed5299053ba">tempest-ServerRescueNegativeTestJSON-1988041396</nova:project>
Apr 17 10:57:52 user nova-compute[82522]:       </nova:owner>
Apr 17 10:57:52 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:57:52 user nova-compute[82522]:       <nova:ports>
Apr 17 10:57:52 user nova-compute[82522]:         <nova:port uuid="8fca060e-eb45-4132-9515-99574c15e1a0">
Apr 17 10:57:52 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 10:57:52 user nova-compute[82522]:         </nova:port>
Apr 17 10:57:52 user nova-compute[82522]:       </nova:ports>
Apr 17 10:57:52 user nova-compute[82522]:     </nova:instance>
Apr 17 10:57:52 user nova-compute[82522]:   </metadata>
Apr 17 10:57:52 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:57:52 user nova-compute[82522]:     <system>
Apr 17 10:57:52 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:57:52 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:57:52 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:57:52 user nova-compute[82522]:       <entry name="serial">385a180f-e722-4826-a6e0-47608461e66e</entry>
Apr 17 10:57:52 user nova-compute[82522]:       <entry name="uuid">385a180f-e722-4826-a6e0-47608461e66e</entry>
Apr 17 10:57:52 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:57:52 user nova-compute[82522]:     </system>
Apr 17 10:57:52 user nova-compute[82522]:   </sysinfo>
Apr 17 10:57:52 user nova-compute[82522]:   <os>
Apr 17 10:57:52 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:57:52 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:57:52 user nova-compute[82522]:   </os>
Apr 17 10:57:52 user nova-compute[82522]:   <features>
Apr 17 10:57:52 user nova-compute[82522]:     <acpi/>
Apr 17 10:57:52 user nova-compute[82522]:     <apic/>
Apr 17 10:57:52 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:57:52 user nova-compute[82522]:   </features>
Apr 17 10:57:52 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:57:52 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:57:52 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:57:52 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:57:52 user nova-compute[82522]:   </clock>
Apr 17 10:57:52 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:57:52 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:57:52 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:57:52 user nova-compute[82522]:   </cpu>
Apr 17 10:57:52 user nova-compute[82522]:   <devices>
Apr 17 10:57:52 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:57:52 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:57:52 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue"/>
Apr 17 10:57:52 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:57:52 user nova-compute[82522]:     </disk>
Apr 17 10:57:52 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:57:52 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:57:52 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk"/>
Apr 17 10:57:52 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 10:57:52 user nova-compute[82522]:     </disk>
Apr 17 10:57:52 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:57:52 user nova-compute[82522]:       <mac address="fa:16:3e:b7:de:f3"/>
Apr 17 10:57:52 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:57:52 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:57:52 user nova-compute[82522]:       <target dev="tap8fca060e-eb"/>
Apr 17 10:57:52 user nova-compute[82522]:     </interface>
Apr 17 10:57:52 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:57:52 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/console.log" append="off"/>
Apr 17 10:57:52 user nova-compute[82522]:     </serial>
Apr 17 10:57:52 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:57:52 user nova-compute[82522]:     <video>
Apr 17 10:57:52 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:57:52 user nova-compute[82522]:     </video>
Apr 17 10:57:52 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:57:52 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:57:52 user nova-compute[82522]:     </rng>
Apr 17 10:57:52 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:57:52 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:57:52 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:57:52 user nova-compute[82522]:     </memballoon>
Apr 17 10:57:52 user nova-compute[82522]:   </devices>
Apr 17 10:57:52 user nova-compute[82522]: </domain>
Apr 17 10:57:52 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:57:52 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Instance destroyed successfully.
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:57:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No VIF found with MAC fa:16:3e:b7:de:f3, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:57:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:57:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] No waiting events found dispatching network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:57:53 user nova-compute[82522]: WARNING nova.compute.manager [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received unexpected event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 for instance with vm_state active and task_state rescuing.
Apr 17 10:57:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] No waiting events found dispatching network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:57:55 user nova-compute[82522]: WARNING nova.compute.manager [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received unexpected event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 for instance with vm_state active and task_state rescuing.
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] No waiting events found dispatching network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:57:55 user nova-compute[82522]: WARNING nova.compute.manager [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received unexpected event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 for instance with vm_state active and task_state rescuing.
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for 385a180f-e722-4826-a6e0-47608461e66e due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729075.7989962, 385a180f-e722-4826-a6e0-47608461e66e => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:57:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] VM Resumed (Lifecycle Event)
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:57:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729075.8007712, 385a180f-e722-4826-a6e0-47608461e66e => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:57:55 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] VM Started (Lifecycle Event)
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:57:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:57:56 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729061.2558944, c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:57:56 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] VM Stopped (Lifecycle Event)
Apr 17 10:57:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2ce5ae1c-f417-4268-aded-fa84b8adec8a None None] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:57:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:58:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:58:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:58:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:58:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:31 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:58:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:58:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:58:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:58:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:33 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:34 user nova-compute[82522]: INFO nova.compute.manager [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Terminating instance
Apr 17 10:58:34 user nova-compute[82522]: DEBUG nova.compute.manager [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received event network-vif-unplugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] Acquiring lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] No waiting events found dispatching network-vif-unplugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received event network-vif-unplugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 10:58:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Instance destroyed successfully.
Apr 17 10:58:35 user nova-compute[82522]: DEBUG nova.objects.instance [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'resources' on Instance uuid 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1214588522',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1214588522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1214588522',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:54:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-47ey9o0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:54:04Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=109ee5e0-8c02-43c2-9415-48bb0c8c3a06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "address": "fa:16:3e:60:23:51", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f89575-06", "ovs_interfaceid": "d4f89575-0631-4344-ac9f-dfb2211df9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:23:51,bridge_name='br-int',has_traffic_filtering=True,id=d4f89575-0631-4344-ac9f-dfb2211df9a0,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f89575-06') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_vif [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:23:51,bridge_name='br-int',has_traffic_filtering=True,id=d4f89575-0631-4344-ac9f-dfb2211df9a0,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f89575-06') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4f89575-06, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:58:35 user nova-compute[82522]: INFO os_vif [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:23:51,bridge_name='br-int',has_traffic_filtering=True,id=d4f89575-0631-4344-ac9f-dfb2211df9a0,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f89575-06')
Apr 17 10:58:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeXRrVJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:58:35 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c61b9d-f51e-4205-822f-c80980b9ae6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:58:35 user nova-compute[82522]: No targets found.
Apr 17 10:58:35 user nova-compute[82522]: iSNS:
Apr 17 10:58:35 user nova-compute[82522]: No targets found.
Apr 17 10:58:35 user nova-compute[82522]: STATIC:
Apr 17 10:58:35 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9
Apr 17 10:58:35 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:58:35 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:58:35 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433
Apr 17 10:58:35 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:58:35 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:58:35 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702
Apr 17 10:58:35 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:58:35 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:58:35 user nova-compute[82522]: FIRMWARE:
Apr 17 10:58:35 user nova-compute[82522]: No targets found.
Apr 17 10:58:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:58:35 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:58:35 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[869fb3b2-dae6-4185-ab48-1deab104ac2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7398bba1-6c13-497b-8078-d61674b8ad4b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:58:35 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:58:35 user nova-compute[82522]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)
Apr 17 10:58:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 (non-flash)
Apr 17 10:58:35 user nova-compute[82522]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:58:35 user nova-compute[82522]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)
Apr 17 10:58:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2a471c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9'): ({'sdc'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Removing single pathed devices sdc {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b214064-0231-4e0c-89b5-893b644e34b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f931524a-959d-4695-b0aa-5dbcde039fd2]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flushing IO for device /dev/sdc {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea58f8b1-6589-45fa-b317-e10a40328e02]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29829d7-59f2-478d-859b-7ad874303525]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1415d572-8f6a-4184-a5ad-b6fbcb426b38]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.162s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[494dfe24-50da-4ea1-8822-51bd54635f72]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9, portal: 172.16.0.220,3260]
Apr 17 10:58:35 user nova-compute[82522]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9, portal: 172.16.0.220,3260] successful.
Apr 17 10:58:35 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9878792-e314-42e2-8384-f3175679bfb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e74e94-8cf5-4189-b365-ff834317562e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.477s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== disconnect_volume: return (479ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:58:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Deleting instance files /opt/stack/data/nova/instances/109ee5e0-8c02-43c2-9415-48bb0c8c3a06_del
Apr 17 10:58:35 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Deletion of /opt/stack/data/nova/instances/109ee5e0-8c02-43c2-9415-48bb0c8c3a06_del complete
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: INFO nova.compute.manager [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Took 1.39 seconds to destroy the instance on the hypervisor.
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:35 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:36 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:58:36 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8387MB free_disk=26.284217834472656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance bb68ad13-6870-417f-8593-4d41724109f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:58:36 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Took 0.90 seconds to deallocate network for instance.
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received event network-vif-plugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] Acquiring lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] No waiting events found dispatching network-vif-plugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:58:36 user nova-compute[82522]: WARNING nova.compute.manager [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received unexpected event network-vif-plugged-d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance with vm_state active and task_state deleting.
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-31568c39-6bf9-42c5-89a2-95745871cfae req-47bae5af-57ec-4132-9275-f9a8fc1d9d92 service nova] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Received event network-vif-deleted-d4f89575-0631-4344-ac9f-dfb2211df9a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:58:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:37 user nova-compute[82522]: INFO nova.compute.manager [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Took 0.82 seconds to detach 1 volumes for instance.
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Deleting volume: f9878792-e314-42e2-8384-f3175679bfb9 {{(pid=82522) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing instance network info cache due to event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] Acquiring lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] Acquired lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:37 user nova-compute[82522]: INFO nova.compute.manager [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Detaching volume 8c5f7bbd-005e-4a88-be2b-ff4f1cb86433
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:58:37 user nova-compute[82522]: INFO nova.virt.block_device [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Attempting to driver detach volume 8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 from mountpoint /dev/vdb
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Attempting to detach device vdb from instance bb68ad13-6870-417f-8593-4d41724109f4 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:58:37 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:58:37 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:58:37 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:58:37 user nova-compute[82522]:   <serial>8c5f7bbd-005e-4a88-be2b-ff4f1cb86433</serial>
Apr 17 10:58:37 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:58:37 user nova-compute[82522]: </disk>
Apr 17 10:58:37 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:37 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully detached device vdb from instance bb68ad13-6870-417f-8593-4d41724109f4 from the persistent domain config.
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb68ad13-6870-417f-8593-4d41724109f4 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 10:58:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 10:58:37 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:58:37 user nova-compute[82522]:   <source dev="/dev/sde"/>
Apr 17 10:58:37 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 10:58:37 user nova-compute[82522]:   <serial>8c5f7bbd-005e-4a88-be2b-ff4f1cb86433</serial>
Apr 17 10:58:37 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 10:58:37 user nova-compute[82522]: </disk>
Apr 17 10:58:37 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 10:58:37 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Deleted allocations for instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06
Apr 17 10:58:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "109ee5e0-8c02-43c2-9415-48bb0c8c3a06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.631s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG nova.network.neutron [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updated VIF entry in instance network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG nova.network.neutron [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating instance_info_cache with network_info: [{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681729118.191433, bb68ad13-6870-417f-8593-4d41724109f4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb68ad13-6870-417f-8593-4d41724109f4 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 10:58:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully detached device vdb from instance bb68ad13-6870-417f-8593-4d41724109f4 from the live domain config.
Apr 17 10:58:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNItcjxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:58:38 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] Releasing lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3312920f-9c71-49bc-a40a-3119831e690c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:58:38 user nova-compute[82522]: No targets found.
Apr 17 10:58:38 user nova-compute[82522]: iSNS:
Apr 17 10:58:38 user nova-compute[82522]: No targets found.
Apr 17 10:58:38 user nova-compute[82522]: STATIC:
Apr 17 10:58:38 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433
Apr 17 10:58:38 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:58:38 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:58:38 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702
Apr 17 10:58:38 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:58:38 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:58:38 user nova-compute[82522]: FIRMWARE:
Apr 17 10:58:38 user nova-compute[82522]: No targets found.
Apr 17 10:58:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:58:38 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:58:38 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5be917-edc5-4c65-9ead-8632c71b336d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5cbdfd-84c9-43cc-a4d3-6b749894adce]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:58:38 user nova-compute[82522]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)
Apr 17 10:58:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:58:38 user nova-compute[82522]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 (non-flash)
Apr 17 10:58:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28442d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433'): ({'sde'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Removing single pathed devices sde {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15804ae-d281-4fb1-90cb-046cc75beb90]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7759bf3-0a2a-4d9d-b1db-739097209569]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flushing IO for device /dev/sde {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2eea1b-5a40-474e-ae6f-627e4efa4bb4]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b066766c-2cc8-49c1-9164-edee49480b78]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] SCSI volumes sde have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5894e7-14df-46b8-b956-4c8f18be63a8]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[221ad98e-faa6-40fb-a737-01e13d98159c]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433, portal: 172.16.0.220,3260]
Apr 17 10:58:38 user nova-compute[82522]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433, portal: 172.16.0.220,3260] successful.
Apr 17 10:58:38 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9581da1e-e5aa-4314-a5e7-656b4aab430c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] <== disconnect_volume: return (318ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing instance network info cache due to event network-changed-e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] Acquiring lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] Acquired lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:58:38 user nova-compute[82522]: DEBUG nova.network.neutron [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Refreshing network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:58:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updated VIF entry in instance network info cache for port e139dcf1-9c53-4c70-849f-1a8126e4d347. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:58:39 user nova-compute[82522]: DEBUG nova.network.neutron [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating instance_info_cache with network_info: [{"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:58:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] Releasing lock "refresh_cache-bb68ad13-6870-417f-8593-4d41724109f4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:58:39 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'flavor' on Instance uuid bb68ad13-6870-417f-8593-4d41724109f4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:58:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.732s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [{"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:58:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:58:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:58:50 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729114.9992313, 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:58:50 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] VM Stopped (Lifecycle Event)
Apr 17 10:58:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-dfadcb95-32e5-489e-9e73-927a231b8729 None None] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:58:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:58:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:58:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:58:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:58:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:58 user nova-compute[82522]: INFO nova.compute.manager [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Terminating instance
Apr 17 10:58:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-unplugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:58 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Instance destroyed successfully.
Apr 17 10:58:58 user nova-compute[82522]: DEBUG nova.objects.instance [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'resources' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T10:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-972682008',display_name='tempest-ServerActionsTestJSON-server-1036404855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-972682008',id=24,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-0qs2xih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:56:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "67386c8f-911d-4398-b449-42af25f6afe3", "address": "fa:16:3e:d3:62:81", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386c8f-91", "ovs_interfaceid": "67386c8f-911d-4398-b449-42af25f6afe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG os_vif [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67386c8f-91, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:58:58 user nova-compute[82522]: INFO os_vif [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:62:81,bridge_name='br-int',has_traffic_filtering=True,id=67386c8f-911d-4398-b449-42af25f6afe3,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386c8f-91')
Apr 17 10:58:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'womeMVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:58:58 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:58:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d052560-ee35-48bb-8e75-b97fc2a5d396]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 10:58:58 user nova-compute[82522]: No targets found.
Apr 17 10:58:58 user nova-compute[82522]: iSNS:
Apr 17 10:58:58 user nova-compute[82522]: No targets found.
Apr 17 10:58:58 user nova-compute[82522]: STATIC:
Apr 17 10:58:58 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702
Apr 17 10:58:58 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 10:58:58 user nova-compute[82522]:                 Iface Name: default
Apr 17 10:58:58 user nova-compute[82522]: FIRMWARE:
Apr 17 10:58:58 user nova-compute[82522]: No targets found.
Apr 17 10:58:58 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 10:58:58 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 10:58:58 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 10:58:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e398334-c005-49e0-a2ea-14ccc9834a44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[575ec4dc-9686-4b90-8779-fa9303dde286]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:58:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 (non-flash)
Apr 17 10:58:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28442c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b050dd-878c-4905-bc16-b0207bdc70b3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c3cfe3-c95a-4890-a055-5903949aeaaf]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e801cd-c483-4b38-a390-1072c05c40f8]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba287eef-784e-4442-b588-97118bd7b791]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a526b562-663d-4c1f-bba0-2199a9dd7a73]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4560c70-b85d-449a-a65f-3c1e1003ad04]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260]
Apr 17 10:58:59 user nova-compute[82522]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702, portal: 172.16.0.220,3260] successful.
Apr 17 10:58:59 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ad981a-53cd-46a2-825a-78feacd3c702 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7675f8-cdf0-4def-a4d9-a5fcede9946f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== disconnect_volume: return (341ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 10:58:59 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Deleting instance files /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38_del
Apr 17 10:58:59 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Deletion of /opt/stack/data/nova/instances/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38_del complete
Apr 17 10:58:59 user nova-compute[82522]: INFO nova.compute.manager [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 17 10:58:59 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:58:59 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:59:00 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:59:00 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Took 0.87 seconds to deallocate network for instance.
Apr 17 10:59:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] Acquiring lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] No waiting events found dispatching network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:59:00 user nova-compute[82522]: WARNING nova.compute.manager [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received unexpected event network-vif-plugged-67386c8f-911d-4398-b449-42af25f6afe3 for instance with vm_state active and task_state deleting.
Apr 17 10:59:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Received event network-vif-deleted-67386c8f-911d-4398-b449-42af25f6afe3 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:00 user nova-compute[82522]: INFO nova.compute.manager [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Took 0.75 seconds to detach 1 volumes for instance.
Apr 17 10:59:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:01 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:59:01 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:59:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:01 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Deleted allocations for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38
Apr 17 10:59:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.177s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:59:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:59:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 10:59:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:59:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 10:59:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:13 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729138.9142263, 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:59:13 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] VM Stopped (Lifecycle Event)
Apr 17 10:59:13 user nova-compute[82522]: DEBUG nova.compute.manager [None req-648c8d48-8ff4-469a-beb5-f5a0057b138e None None] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:59:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:59:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "5ce6b406-b4f0-4b35-8925-b0a06e637775" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:31 user nova-compute[82522]: INFO nova.compute.manager [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Terminating instance
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:59:31 user nova-compute[82522]: INFO nova.compute.claims [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Claim successful on node user
Apr 17 10:59:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-unplugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] No waiting events found dispatching network-vif-unplugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.compute.manager [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-unplugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:59:31 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:59:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:59:31 user nova-compute[82522]: INFO nova.virt.block_device [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Booting with volume 32fcecef-5fb8-4df1-9e05-f988030c838f at /dev/vda
Apr 17 10:59:32 user nova-compute[82522]: DEBUG nova.policy [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG os_brick.utils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e49cf18-5081-4fd5-8946-b98ab6c40754]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[57036725-30b0-4d6b-a5a6-1f3d5a482b03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d126e8-ea63-401b-9d84-5b77fbaddcdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[980f0552-9414-4093-b4d3-a6754b5ca397]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 10:59:32 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[54704d22-9a02-4159-aaeb-6f1b69188375]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG os_brick.utils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Updating existing volume attachment record: 44505705-8d0c-4d7f-a571-f106d55b2b80 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 10:59:32 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Instance destroyed successfully.
Apr 17 10:59:32 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'resources' on Instance uuid bb68ad13-6870-417f-8593-4d41724109f4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1044969384',display_name='tempest-TestMinimumBasicScenario-server-1044969384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1044969384',id=32,image_ref='3dd99358-1e69-4b00-8c6f-b2c7b3320f3e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2LcQKOJIbCueTFlVX50X2EGvDm6laToZFGZ7y29eU+7fJvpuVyKrKflWnfn7Z0uS0xG8jdApM7wiOOz9SiILReN8+PYwYvEof/j98ElqWxcbuwNLVD70dwsz0wd5YmQg==',key_name='tempest-TestMinimumBasicScenario-1990324644',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='455ea6870abe450ba413ffabf4d4097e',ramdisk_id='',reservation_id='r-25nmy3ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3dd99358-1e69-4b00-8c6f-b2c7b3320f3e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1309632250',owner_user_name='tempest-TestMinimumBasicScenario-1309632250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:56:52Z,user_data=None,user_id='df693038f49145b9854ae18d246dde2f',uuid=bb68ad13-6870-417f-8593-4d41724109f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converting VIF {"id": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "address": "fa:16:3e:1f:9c:b6", "network": {"id": "519dcb44-4125-4a92-9e76-0c22271f7ca8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-371817907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "455ea6870abe450ba413ffabf4d4097e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape139dcf1-9c", "ovs_interfaceid": "e139dcf1-9c53-4c70-849f-1a8126e4d347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e139dcf1-9c53-4c70-849f-1a8126e4d347,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape139dcf1-9c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG os_vif [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e139dcf1-9c53-4c70-849f-1a8126e4d347,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape139dcf1-9c') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape139dcf1-9c, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:59:32 user nova-compute[82522]: INFO os_vif [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e139dcf1-9c53-4c70-849f-1a8126e4d347,network=Network(519dcb44-4125-4a92-9e76-0c22271f7ca8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape139dcf1-9c')
Apr 17 10:59:32 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Deleting instance files /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4_del
Apr 17 10:59:32 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Deletion of /opt/stack/data/nova/instances/bb68ad13-6870-417f-8593-4d41724109f4_del complete
Apr 17 10:59:32 user nova-compute[82522]: INFO nova.compute.manager [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 17 10:59:32 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 10:59:32 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: bb68ad13-6870-417f-8593-4d41724109f4] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Successfully created port: c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:59:33 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Took 0.81 seconds to deallocate network for instance.
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-c829d3d9-6f88-4742-b272-610735ff0857 req-ef05e913-8534-46a6-8dcb-437ea3f74cfd service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-deleted-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:33 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Deleted allocations for instance bb68ad13-6870-417f-8593-4d41724109f4
Apr 17 10:59:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "bb68ad13-6870-417f-8593-4d41724109f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] Acquiring lock "bb68ad13-6870-417f-8593-4d41724109f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] Lock "bb68ad13-6870-417f-8593-4d41724109f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] No waiting events found dispatching network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:59:33 user nova-compute[82522]: WARNING nova.compute.manager [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Received unexpected event network-vif-plugged-e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance with vm_state deleted and task_state None.
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Successfully updated port: c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "refresh_cache-5ce6b406-b4f0-4b35-8925-b0a06e637775" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquired lock "refresh_cache-5ce6b406-b4f0-4b35-8925-b0a06e637775" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:59:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:59:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:59:34 user nova-compute[82522]: DEBUG nova.network.neutron [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Updating instance_info_cache with network_info: [{"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:59:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Releasing lock "refresh_cache-5ce6b406-b4f0-4b35-8925-b0a06e637775" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:59:34 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Instance network_info: |[{"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:59:35 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:59:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received event network-changed-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Refreshing instance network info cache due to event network-changed-c6caf384-eff7-432e-a749-88e97ee14e4a. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:59:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] Acquiring lock "refresh_cache-5ce6b406-b4f0-4b35-8925-b0a06e637775" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:59:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] Acquired lock "refresh_cache-5ce6b406-b4f0-4b35-8925-b0a06e637775" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:59:35 user nova-compute[82522]: DEBUG nova.network.neutron [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Refreshing network info cache for port c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.network.neutron [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Updated VIF entry in instance network info cache for port c6caf384-eff7-432e-a749-88e97ee14e4a. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.network.neutron [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Updating instance_info_cache with network_info: [{"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] Releasing lock "refresh_cache-5ce6b406-b4f0-4b35-8925-b0a06e637775" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:59:36 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Creating image(s)
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Ensure instance console log exists: /opt/stack/data/nova/instances/5ce6b406-b4f0-4b35-8925-b0a06e637775/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Start _get_guest_xml network_info=[{"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '44505705-8d0c-4d7f-a571-f106d55b2b80', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huYkKzqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ce6b406-b4f0-4b35-8925-b0a06e637775', 'attached_at': '', 'detached_at': '', 'volume_id': '32fcecef-5fb8-4df1-9e05-f988030c838f', 'serial': '32fcecef-5fb8-4df1-9e05-f988030c838f'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:36 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:59:36 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huYkKzqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 10:59:36 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:59:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:59:36 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 10:59:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 10:59:36 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 10:59:36 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a7503e-6631-4aa8-af42-8dadee2b65cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 10:59:37 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e78956-42ea-472a-820b-1cae8a513f02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f] added
Apr 17 10:59:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ace6db-e7f8-4fd6-8b9c-5cdb051363f9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4ea08c-b46c-4c0e-bd6a-9819b6fdf53c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huYkKzqe {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:59:37 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:59:37 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=26.321727752685547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huYkKzqe" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd81b7ed-9fe4-4db4-8567-2e4e46d90aa0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'huYkKzqe'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0b5e09-995d-4301-bf3f-845334cd88c9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f7dd63-05db-4f36-ab72-1f7cc1250e05]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 17 10:59:37 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 17 10:59:37 user nova-compute[82522]:  {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:59:37 user nova-compute[82522]: WARNING os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 17 10:59:37 user nova-compute[82522]: 
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbacf79-6841-4cbd-9973-fb91708667e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260]
Apr 17 10:59:37 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260] successful.
Apr 17 10:59:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8aa8e2-7f64-41df-b15d-b6c26ad05df4]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[12084787-c418-4370-b493-3fa51cc4a0de]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 10:59:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 10:59:37 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.584s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c83427-e12a-4241-8310-de74f97f0001]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huYkKzqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 10:59:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.624s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== connect_volume: return (1626ms) {'type': 'block', 'scsi_wwn': '23765366234343537', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765366234343537', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1988112604',display_name='tempest-TestVolumeBootPattern-server-1988112604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1988112604',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A==',key_name='tempest-TestVolumeBootPattern-44084031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-ox5l0jv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:59:32Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=5ce6b406-b4f0-4b35-8925-b0a06e637775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=c6caf384-eff7-432e-a749-88e97ee14e4a,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6caf384-ef') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.objects.instance [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ce6b406-b4f0-4b35-8925-b0a06e637775 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:59:38 user nova-compute[82522]:   <uuid>5ce6b406-b4f0-4b35-8925-b0a06e637775</uuid>
Apr 17 10:59:38 user nova-compute[82522]:   <name>instance-00000024</name>
Apr 17 10:59:38 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:59:38 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:59:38 user nova-compute[82522]:   <metadata>
Apr 17 10:59:38 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:59:38 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:59:38 user nova-compute[82522]:       <nova:name>tempest-TestVolumeBootPattern-server-1988112604</nova:name>
Apr 17 10:59:38 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:59:36</nova:creationTime>
Apr 17 10:59:38 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:59:38 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:59:38 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:59:38 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:59:38 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:59:38 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:59:38 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:59:38 user nova-compute[82522]:       <nova:owner>
Apr 17 10:59:38 user nova-compute[82522]:         <nova:user uuid="0e4ed1192974484bba2d4392f4d011c2">tempest-TestVolumeBootPattern-1777404437-project-member</nova:user>
Apr 17 10:59:38 user nova-compute[82522]:         <nova:project uuid="4fc3b8e3925847d48b522206a8875d3f">tempest-TestVolumeBootPattern-1777404437</nova:project>
Apr 17 10:59:38 user nova-compute[82522]:       </nova:owner>
Apr 17 10:59:38 user nova-compute[82522]:       <nova:ports>
Apr 17 10:59:38 user nova-compute[82522]:         <nova:port uuid="c6caf384-eff7-432e-a749-88e97ee14e4a">
Apr 17 10:59:38 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 17 10:59:38 user nova-compute[82522]:         </nova:port>
Apr 17 10:59:38 user nova-compute[82522]:       </nova:ports>
Apr 17 10:59:38 user nova-compute[82522]:     </nova:instance>
Apr 17 10:59:38 user nova-compute[82522]:   </metadata>
Apr 17 10:59:38 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:59:38 user nova-compute[82522]:     <system>
Apr 17 10:59:38 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:59:38 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:59:38 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:59:38 user nova-compute[82522]:       <entry name="serial">5ce6b406-b4f0-4b35-8925-b0a06e637775</entry>
Apr 17 10:59:38 user nova-compute[82522]:       <entry name="uuid">5ce6b406-b4f0-4b35-8925-b0a06e637775</entry>
Apr 17 10:59:38 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:59:38 user nova-compute[82522]:     </system>
Apr 17 10:59:38 user nova-compute[82522]:   </sysinfo>
Apr 17 10:59:38 user nova-compute[82522]:   <os>
Apr 17 10:59:38 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:59:38 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:59:38 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:59:38 user nova-compute[82522]:   </os>
Apr 17 10:59:38 user nova-compute[82522]:   <features>
Apr 17 10:59:38 user nova-compute[82522]:     <acpi/>
Apr 17 10:59:38 user nova-compute[82522]:     <apic/>
Apr 17 10:59:38 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:59:38 user nova-compute[82522]:   </features>
Apr 17 10:59:38 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:59:38 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:59:38 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:59:38 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:59:38 user nova-compute[82522]:   </clock>
Apr 17 10:59:38 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:59:38 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:59:38 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:59:38 user nova-compute[82522]:   </cpu>
Apr 17 10:59:38 user nova-compute[82522]:   <devices>
Apr 17 10:59:38 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 10:59:38 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 10:59:38 user nova-compute[82522]:       <source dev="/dev/sdb"/>
Apr 17 10:59:38 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:59:38 user nova-compute[82522]:       <serial>32fcecef-5fb8-4df1-9e05-f988030c838f</serial>
Apr 17 10:59:38 user nova-compute[82522]:     </disk>
Apr 17 10:59:38 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:59:38 user nova-compute[82522]:       <mac address="fa:16:3e:93:d6:ad"/>
Apr 17 10:59:38 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:59:38 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:59:38 user nova-compute[82522]:       <target dev="tapc6caf384-ef"/>
Apr 17 10:59:38 user nova-compute[82522]:     </interface>
Apr 17 10:59:38 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:59:38 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/5ce6b406-b4f0-4b35-8925-b0a06e637775/console.log" append="off"/>
Apr 17 10:59:38 user nova-compute[82522]:     </serial>
Apr 17 10:59:38 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:59:38 user nova-compute[82522]:     <video>
Apr 17 10:59:38 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:59:38 user nova-compute[82522]:     </video>
Apr 17 10:59:38 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:59:38 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:59:38 user nova-compute[82522]:     </rng>
Apr 17 10:59:38 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:59:38 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:59:38 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:59:38 user nova-compute[82522]:     </memballoon>
Apr 17 10:59:38 user nova-compute[82522]:   </devices>
Apr 17 10:59:38 user nova-compute[82522]: </domain>
Apr 17 10:59:38 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1988112604',display_name='tempest-TestVolumeBootPattern-server-1988112604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1988112604',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A==',key_name='tempest-TestVolumeBootPattern-44084031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-ox5l0jv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:59:32Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=5ce6b406-b4f0-4b35-8925-b0a06e637775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=c6caf384-eff7-432e-a749-88e97ee14e4a,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6caf384-ef') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG os_vif [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=c6caf384-eff7-432e-a749-88e97ee14e4a,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6caf384-ef') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6caf384-ef, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6caf384-ef, col_values=(('external_ids', {'iface-id': 'c6caf384-eff7-432e-a749-88e97ee14e4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:d6:ad', 'vm-uuid': '5ce6b406-b4f0-4b35-8925-b0a06e637775'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:38 user nova-compute[82522]: INFO os_vif [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=c6caf384-eff7-432e-a749-88e97ee14e4a,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6caf384-ef')
Apr 17 10:59:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:59:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No VIF found with MAC fa:16:3e:93:d6:ad, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received event network-vif-plugged-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] Acquiring lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] No waiting events found dispatching network-vif-plugged-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:59:40 user nova-compute[82522]: WARNING nova.compute.manager [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received unexpected event network-vif-plugged-c6caf384-eff7-432e-a749-88e97ee14e4a for instance with vm_state building and task_state spawning.
Apr 17 10:59:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729182.149027, 5ce6b406-b4f0-4b35-8925-b0a06e637775 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:59:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] VM Resumed (Lifecycle Event)
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:59:42 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Instance spawned successfully.
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 10:59:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729182.1506033, 5ce6b406-b4f0-4b35-8925-b0a06e637775 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:59:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] VM Started (Lifecycle Event)
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:59:42 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:59:42 user nova-compute[82522]: INFO nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Took 5.39 seconds to spawn the instance on the hypervisor.
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received event network-vif-plugged-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] Acquiring lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] No waiting events found dispatching network-vif-plugged-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:59:42 user nova-compute[82522]: WARNING nova.compute.manager [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received unexpected event network-vif-plugged-c6caf384-eff7-432e-a749-88e97ee14e4a for instance with vm_state building and task_state spawning.
Apr 17 10:59:42 user nova-compute[82522]: INFO nova.compute.manager [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Took 10.84 seconds to build instance.
Apr 17 10:59:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.940s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:59:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 10:59:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:47 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729172.2551782, bb68ad13-6870-417f-8593-4d41724109f4 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:59:47 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: bb68ad13-6870-417f-8593-4d41724109f4] VM Stopped (Lifecycle Event)
Apr 17 10:59:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-fde10366-42e4-4005-821d-492c9440fc27 None None] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:59:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 10:59:50 user nova-compute[82522]: INFO nova.compute.claims [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Claim successful on node user
Apr 17 10:59:50 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 10:59:50 user nova-compute[82522]: DEBUG nova.network.neutron [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 10:59:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.policy [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 10:59:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Creating image(s)
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "/opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "/opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.153s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk 1073741824" returned: 0 in 0.066s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Cannot resize image /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.objects.instance [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'migration_context' on Instance uuid 3e25766f-ccf8-435e-9d56-1f371d52bbcf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.network.neutron [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Successfully created port: 50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Ensure instance console log exists: /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Successfully updated port: 50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received event network-changed-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Refreshing instance network info cache due to event network-changed-50e629ae-2997-44f7-985a-9f0b73c8e576. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] Acquiring lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.network.neutron [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updating instance_info_cache with network_info: [{"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Instance network_info: |[{"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] Acquired lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.network.neutron [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Refreshing network info cache for port 50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Start _get_guest_xml network_info=[{"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 10:59:52 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:59:52 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-455400217',display_name='tempest-ServerActionsTestJSON-server-455400217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-455400217',id=37,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-4cnvgred',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=3e25766f-ccf8-435e-9d56-1f371d52bbcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:7c:82,bridge_name='br-int',has_traffic_filtering=True,id=50e629ae-2997-44f7-985a-9f0b73c8e576,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e629ae-29') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e25766f-ccf8-435e-9d56-1f371d52bbcf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 10:59:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] End _get_guest_xml xml=<domain type="kvm">
Apr 17 10:59:52 user nova-compute[82522]:   <uuid>3e25766f-ccf8-435e-9d56-1f371d52bbcf</uuid>
Apr 17 10:59:52 user nova-compute[82522]:   <name>instance-00000025</name>
Apr 17 10:59:52 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 10:59:52 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 10:59:52 user nova-compute[82522]:   <metadata>
Apr 17 10:59:52 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 10:59:52 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 10:59:52 user nova-compute[82522]:       <nova:name>tempest-ServerActionsTestJSON-server-455400217</nova:name>
Apr 17 10:59:52 user nova-compute[82522]:       <nova:creationTime>2023-04-17 10:59:52</nova:creationTime>
Apr 17 10:59:52 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 10:59:52 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 10:59:52 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 10:59:52 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 10:59:52 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 10:59:52 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 10:59:52 user nova-compute[82522]:       </nova:flavor>
Apr 17 10:59:52 user nova-compute[82522]:       <nova:owner>
Apr 17 10:59:52 user nova-compute[82522]:         <nova:user uuid="a7e218d771db49e88d13d3b088f3d88a">tempest-ServerActionsTestJSON-2107442540-project-member</nova:user>
Apr 17 10:59:52 user nova-compute[82522]:         <nova:project uuid="cc1b39ff9581474b87c58164e5cafa00">tempest-ServerActionsTestJSON-2107442540</nova:project>
Apr 17 10:59:52 user nova-compute[82522]:       </nova:owner>
Apr 17 10:59:52 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 10:59:52 user nova-compute[82522]:       <nova:ports>
Apr 17 10:59:52 user nova-compute[82522]:         <nova:port uuid="50e629ae-2997-44f7-985a-9f0b73c8e576">
Apr 17 10:59:52 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 17 10:59:52 user nova-compute[82522]:         </nova:port>
Apr 17 10:59:52 user nova-compute[82522]:       </nova:ports>
Apr 17 10:59:52 user nova-compute[82522]:     </nova:instance>
Apr 17 10:59:52 user nova-compute[82522]:   </metadata>
Apr 17 10:59:52 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 10:59:52 user nova-compute[82522]:     <system>
Apr 17 10:59:52 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 10:59:52 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 10:59:52 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 10:59:52 user nova-compute[82522]:       <entry name="serial">3e25766f-ccf8-435e-9d56-1f371d52bbcf</entry>
Apr 17 10:59:52 user nova-compute[82522]:       <entry name="uuid">3e25766f-ccf8-435e-9d56-1f371d52bbcf</entry>
Apr 17 10:59:52 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 10:59:52 user nova-compute[82522]:     </system>
Apr 17 10:59:52 user nova-compute[82522]:   </sysinfo>
Apr 17 10:59:52 user nova-compute[82522]:   <os>
Apr 17 10:59:52 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 10:59:52 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 10:59:52 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 10:59:52 user nova-compute[82522]:   </os>
Apr 17 10:59:52 user nova-compute[82522]:   <features>
Apr 17 10:59:52 user nova-compute[82522]:     <acpi/>
Apr 17 10:59:52 user nova-compute[82522]:     <apic/>
Apr 17 10:59:52 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 10:59:52 user nova-compute[82522]:   </features>
Apr 17 10:59:52 user nova-compute[82522]:   <clock offset="utc">
Apr 17 10:59:52 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 10:59:52 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 10:59:52 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 10:59:52 user nova-compute[82522]:   </clock>
Apr 17 10:59:52 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 10:59:52 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 10:59:52 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 10:59:52 user nova-compute[82522]:   </cpu>
Apr 17 10:59:52 user nova-compute[82522]:   <devices>
Apr 17 10:59:52 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 10:59:52 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 10:59:52 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk"/>
Apr 17 10:59:52 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 10:59:52 user nova-compute[82522]:     </disk>
Apr 17 10:59:52 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 10:59:52 user nova-compute[82522]:       <mac address="fa:16:3e:44:7c:82"/>
Apr 17 10:59:52 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:59:52 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 10:59:52 user nova-compute[82522]:       <target dev="tap50e629ae-29"/>
Apr 17 10:59:52 user nova-compute[82522]:     </interface>
Apr 17 10:59:52 user nova-compute[82522]:     <serial type="pty">
Apr 17 10:59:52 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/console.log" append="off"/>
Apr 17 10:59:52 user nova-compute[82522]:     </serial>
Apr 17 10:59:52 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 10:59:52 user nova-compute[82522]:     <video>
Apr 17 10:59:52 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 10:59:52 user nova-compute[82522]:     </video>
Apr 17 10:59:52 user nova-compute[82522]:     <rng model="virtio">
Apr 17 10:59:52 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 10:59:52 user nova-compute[82522]:     </rng>
Apr 17 10:59:52 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 10:59:52 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 10:59:52 user nova-compute[82522]:       <stats period="10"/>
Apr 17 10:59:52 user nova-compute[82522]:     </memballoon>
Apr 17 10:59:52 user nova-compute[82522]:   </devices>
Apr 17 10:59:52 user nova-compute[82522]: </domain>
Apr 17 10:59:52 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-455400217',display_name='tempest-ServerActionsTestJSON-server-455400217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-455400217',id=37,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-4cnvgred',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=3e25766f-ccf8-435e-9d56-1f371d52bbcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:7c:82,bridge_name='br-int',has_traffic_filtering=True,id=50e629ae-2997-44f7-985a-9f0b73c8e576,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e629ae-29') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG os_vif [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:7c:82,bridge_name='br-int',has_traffic_filtering=True,id=50e629ae-2997-44f7-985a-9f0b73c8e576,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e629ae-29') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50e629ae-29, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50e629ae-29, col_values=(('external_ids', {'iface-id': '50e629ae-2997-44f7-985a-9f0b73c8e576', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:7c:82', 'vm-uuid': '3e25766f-ccf8-435e-9d56-1f371d52bbcf'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:53 user nova-compute[82522]: INFO os_vif [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:7c:82,bridge_name='br-int',has_traffic_filtering=True,id=50e629ae-2997-44f7-985a-9f0b73c8e576,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e629ae-29')
Apr 17 10:59:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No VIF found with MAC fa:16:3e:44:7c:82, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updated VIF entry in instance network info cache for port 50e629ae-2997-44f7-985a-9f0b73c8e576. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG nova.network.neutron [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updating instance_info_cache with network_info: [{"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 10:59:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] Releasing lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 10:59:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received event network-vif-plugged-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] Acquiring lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] No waiting events found dispatching network-vif-plugged-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:59:54 user nova-compute[82522]: WARNING nova.compute.manager [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received unexpected event network-vif-plugged-50e629ae-2997-44f7-985a-9f0b73c8e576 for instance with vm_state building and task_state spawning.
Apr 17 10:59:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729196.591071, 3e25766f-ccf8-435e-9d56-1f371d52bbcf => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:59:56 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] VM Resumed (Lifecycle Event)
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 10:59:56 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Instance spawned successfully.
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 10:59:56 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729196.5926425, 3e25766f-ccf8-435e-9d56-1f371d52bbcf => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 10:59:56 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] VM Started (Lifecycle Event)
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 10:59:56 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received event network-vif-plugged-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] Acquiring lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] No waiting events found dispatching network-vif-plugged-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 10:59:56 user nova-compute[82522]: WARNING nova.compute.manager [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received unexpected event network-vif-plugged-50e629ae-2997-44f7-985a-9f0b73c8e576 for instance with vm_state building and task_state spawning.
Apr 17 10:59:56 user nova-compute[82522]: INFO nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 17 10:59:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 10:59:56 user nova-compute[82522]: INFO nova.compute.manager [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Took 6.16 seconds to build instance.
Apr 17 10:59:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 10:59:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 10:59:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:28 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 11:00:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 11:00:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:34 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:35 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:36 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:37 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:37 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:00:37 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:00:37 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8504MB free_disk=26.32144546508789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:00:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:00:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 11:00:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updating instance_info_cache with network_info: [{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:00:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:44 user nova-compute[82522]: INFO nova.compute.manager [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Rescuing
Apr 17 11:00:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:00:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquired lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:00:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:00:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:00:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Releasing lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:00:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.compute.manager [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-unplugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.compute.manager [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-unplugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:00:45 user nova-compute[82522]: WARNING nova.compute.manager [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-unplugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state active and task_state rescuing.
Apr 17 11:00:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Instance destroyed successfully.
Apr 17 11:00:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Attempting rescue
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82522) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Instance directory exists: not creating {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 11:00:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Creating image(s)
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'trusted_certs' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.rescue {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.rescue" returned: 0 in 0.057s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'migration_context' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Start _get_guest_xml network_info=[{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "vif_mac": "fa:16:3e:07:47:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '66764afd-311a-41a0-a068-b2937b23acba', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'resources' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'numa_topology' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:00:45 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:00:45 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'vcpu_model' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:55:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1021874936',display_name='tempest-ServerRescueNegativeTestJSON-server-1021874936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1021874936',id=34,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-w9lehq7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T10:56:10Z,user_data=None,user_id='30c15ce534a649ae8a971b33221e2500',uuid=06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "vif_mac": "fa:16:3e:07:47:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "vif_mac": "fa:16:3e:07:47:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:47:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c6c71a5-0190-4112-9044-5c238344dc88,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6c71a5-01') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'pci_devices' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:00:45 user nova-compute[82522]:   <uuid>06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f</uuid>
Apr 17 11:00:45 user nova-compute[82522]:   <name>instance-00000022</name>
Apr 17 11:00:45 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:00:45 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:00:45 user nova-compute[82522]:   <metadata>
Apr 17 11:00:45 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:00:45 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:00:45 user nova-compute[82522]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1021874936</nova:name>
Apr 17 11:00:45 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:00:45</nova:creationTime>
Apr 17 11:00:45 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:00:45 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:00:45 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:00:45 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:00:45 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:00:45 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:00:45 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:00:45 user nova-compute[82522]:       <nova:owner>
Apr 17 11:00:45 user nova-compute[82522]:         <nova:user uuid="30c15ce534a649ae8a971b33221e2500">tempest-ServerRescueNegativeTestJSON-1988041396-project-member</nova:user>
Apr 17 11:00:45 user nova-compute[82522]:         <nova:project uuid="3747b7d3c6844772b0e6eed5299053ba">tempest-ServerRescueNegativeTestJSON-1988041396</nova:project>
Apr 17 11:00:45 user nova-compute[82522]:       </nova:owner>
Apr 17 11:00:45 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 11:00:45 user nova-compute[82522]:       <nova:ports>
Apr 17 11:00:45 user nova-compute[82522]:         <nova:port uuid="9c6c71a5-0190-4112-9044-5c238344dc88">
Apr 17 11:00:45 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 11:00:45 user nova-compute[82522]:         </nova:port>
Apr 17 11:00:45 user nova-compute[82522]:       </nova:ports>
Apr 17 11:00:45 user nova-compute[82522]:     </nova:instance>
Apr 17 11:00:45 user nova-compute[82522]:   </metadata>
Apr 17 11:00:45 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:00:45 user nova-compute[82522]:     <system>
Apr 17 11:00:45 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:00:45 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:00:45 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:00:45 user nova-compute[82522]:       <entry name="serial">06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f</entry>
Apr 17 11:00:45 user nova-compute[82522]:       <entry name="uuid">06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f</entry>
Apr 17 11:00:45 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:00:45 user nova-compute[82522]:     </system>
Apr 17 11:00:45 user nova-compute[82522]:   </sysinfo>
Apr 17 11:00:45 user nova-compute[82522]:   <os>
Apr 17 11:00:45 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:00:45 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:00:45 user nova-compute[82522]:   </os>
Apr 17 11:00:45 user nova-compute[82522]:   <features>
Apr 17 11:00:45 user nova-compute[82522]:     <acpi/>
Apr 17 11:00:45 user nova-compute[82522]:     <apic/>
Apr 17 11:00:45 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:00:45 user nova-compute[82522]:   </features>
Apr 17 11:00:45 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:00:45 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:00:45 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:00:45 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:00:45 user nova-compute[82522]:   </clock>
Apr 17 11:00:45 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:00:45 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:00:45 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:00:45 user nova-compute[82522]:   </cpu>
Apr 17 11:00:45 user nova-compute[82522]:   <devices>
Apr 17 11:00:45 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:00:45 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:00:45 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.rescue"/>
Apr 17 11:00:45 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:00:45 user nova-compute[82522]:     </disk>
Apr 17 11:00:45 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:00:45 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:00:45 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk"/>
Apr 17 11:00:45 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 11:00:45 user nova-compute[82522]:     </disk>
Apr 17 11:00:45 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:00:45 user nova-compute[82522]:       <mac address="fa:16:3e:07:47:fb"/>
Apr 17 11:00:45 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:00:45 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:00:45 user nova-compute[82522]:       <target dev="tap9c6c71a5-01"/>
Apr 17 11:00:45 user nova-compute[82522]:     </interface>
Apr 17 11:00:45 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:00:45 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/console.log" append="off"/>
Apr 17 11:00:45 user nova-compute[82522]:     </serial>
Apr 17 11:00:45 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:00:45 user nova-compute[82522]:     <video>
Apr 17 11:00:45 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:00:45 user nova-compute[82522]:     </video>
Apr 17 11:00:45 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:00:45 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:00:45 user nova-compute[82522]:     </rng>
Apr 17 11:00:45 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:00:45 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:00:45 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:00:45 user nova-compute[82522]:     </memballoon>
Apr 17 11:00:45 user nova-compute[82522]:   </devices>
Apr 17 11:00:45 user nova-compute[82522]: </domain>
Apr 17 11:00:45 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:00:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Instance destroyed successfully.
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:00:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No VIF found with MAC fa:16:3e:07:47:fb, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:00:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:47 user nova-compute[82522]: DEBUG nova.compute.manager [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:00:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:00:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:00:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:00:47 user nova-compute[82522]: DEBUG nova.compute.manager [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:00:47 user nova-compute[82522]: WARNING nova.compute.manager [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state active and task_state rescuing.
Apr 17 11:00:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:00:49 user nova-compute[82522]: WARNING nova.compute.manager [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state active and task_state rescuing.
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:00:49 user nova-compute[82522]: WARNING nova.compute.manager [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state active and task_state rescuing.
Apr 17 11:00:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729249.9428916, 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:00:49 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] VM Resumed (Lifecycle Event)
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:00:49 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 17 11:00:49 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729249.9441013, 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:00:49 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] VM Started (Lifecycle Event)
Apr 17 11:00:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:00:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:00:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:00:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received event network-changed-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:01:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Refreshing instance network info cache due to event network-changed-c6caf384-eff7-432e-a749-88e97ee14e4a. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:01:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] Acquiring lock "refresh_cache-5ce6b406-b4f0-4b35-8925-b0a06e637775" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:01:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] Acquired lock "refresh_cache-5ce6b406-b4f0-4b35-8925-b0a06e637775" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:01:23 user nova-compute[82522]: DEBUG nova.network.neutron [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Refreshing network info cache for port c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "5ce6b406-b4f0-4b35-8925-b0a06e637775" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:24 user nova-compute[82522]: INFO nova.compute.manager [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Terminating instance
Apr 17 11:01:24 user nova-compute[82522]: DEBUG nova.compute.manager [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG nova.network.neutron [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Updated VIF entry in instance network info cache for port c6caf384-eff7-432e-a749-88e97ee14e4a. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG nova.network.neutron [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Updating instance_info_cache with network_info: [{"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] Releasing lock "refresh_cache-5ce6b406-b4f0-4b35-8925-b0a06e637775" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:24 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Instance destroyed successfully.
Apr 17 11:01:24 user nova-compute[82522]: DEBUG nova.objects.instance [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'resources' on Instance uuid 5ce6b406-b4f0-4b35-8925-b0a06e637775 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1988112604',display_name='tempest-TestVolumeBootPattern-server-1988112604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1988112604',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A==',key_name='tempest-TestVolumeBootPattern-44084031',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-ox5l0jv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:59:42Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=5ce6b406-b4f0-4b35-8925-b0a06e637775,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "c6caf384-eff7-432e-a749-88e97ee14e4a", "address": "fa:16:3e:93:d6:ad", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6caf384-ef", "ovs_interfaceid": "c6caf384-eff7-432e-a749-88e97ee14e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=c6caf384-eff7-432e-a749-88e97ee14e4a,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6caf384-ef') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG os_vif [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=c6caf384-eff7-432e-a749-88e97ee14e4a,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6caf384-ef') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6caf384-ef, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:01:24 user nova-compute[82522]: INFO os_vif [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=c6caf384-eff7-432e-a749-88e97ee14e4a,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6caf384-ef')
Apr 17 11:01:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huYkKzqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:01:24 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:01:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a90a5f-8807-4f70-a838-bf775e28434a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 11:01:24 user nova-compute[82522]: No targets found.
Apr 17 11:01:24 user nova-compute[82522]: iSNS:
Apr 17 11:01:24 user nova-compute[82522]: No targets found.
Apr 17 11:01:24 user nova-compute[82522]: STATIC:
Apr 17 11:01:24 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f
Apr 17 11:01:24 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:01:24 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:01:24 user nova-compute[82522]: FIRMWARE:
Apr 17 11:01:24 user nova-compute[82522]: No targets found.
Apr 17 11:01:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 11:01:24 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 11:01:24 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 11:01:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5837d80-f63e-45e0-9637-3f0e52d0dab7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdefe19-79f0-464e-823f-7bb5f086b4b0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:01:25 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:01:25 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2843a2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e125f-2f6e-41e1-b420-57514e3de1cc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd716592-6c42-4096-be41-aa3d5373d034]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e87077-2cb8-41fa-b5bd-d5723ac5cedd]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d1a849-21af-4787-a081-31b69724139f]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[52687bf4-33bd-4791-b494-8f8e7fff95c1]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69b9eeb-b29e-4845-b968-033775d58e00]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260]
Apr 17 11:01:25 user nova-compute[82522]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260] successful.
Apr 17 11:01:25 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b725314a-521f-4a53-9385-27b88386ea73]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== disconnect_volume: return (318ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 11:01:25 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Deleting instance files /opt/stack/data/nova/instances/5ce6b406-b4f0-4b35-8925-b0a06e637775_del
Apr 17 11:01:25 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Deletion of /opt/stack/data/nova/instances/5ce6b406-b4f0-4b35-8925-b0a06e637775_del complete
Apr 17 11:01:25 user nova-compute[82522]: INFO nova.compute.manager [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received event network-vif-unplugged-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Acquiring lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] No waiting events found dispatching network-vif-unplugged-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received event network-vif-unplugged-c6caf384-eff7-432e-a749-88e97ee14e4a for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received event network-vif-plugged-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Acquiring lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:25 user nova-compute[82522]: DEBUG nova.compute.manager [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] No waiting events found dispatching network-vif-plugged-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:01:25 user nova-compute[82522]: WARNING nova.compute.manager [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received unexpected event network-vif-plugged-c6caf384-eff7-432e-a749-88e97ee14e4a for instance with vm_state active and task_state deleting.
Apr 17 11:01:26 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:01:26 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Took 0.97 seconds to deallocate network for instance.
Apr 17 11:01:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-62761dfb-9b41-4c1f-b3d7-f5f7d136ab16 req-c61ad364-87d7-4d38-9f12-7c0d003eae53 service nova] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Received event network-vif-deleted-c6caf384-eff7-432e-a749-88e97ee14e4a {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:01:27 user nova-compute[82522]: INFO nova.compute.manager [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Took 0.78 seconds to detach 1 volumes for instance.
Apr 17 11:01:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:27 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 11:01:27 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 11:01:27 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 11:01:27 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 11:01:27 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 11:01:27 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:01:27 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:01:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:27 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Deleted allocations for instance 5ce6b406-b4f0-4b35-8925-b0a06e637775
Apr 17 11:01:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "5ce6b406-b4f0-4b35-8925-b0a06e637775" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.446s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:35 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:37 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:38 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729284.909215, 5ce6b406-b4f0-4b35-8925-b0a06e637775 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:01:40 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] VM Stopped (Lifecycle Event)
Apr 17 11:01:40 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:01:40 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8604MB free_disk=26.300724029541016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e0095d62-f130-4bfc-8897-b71244cf4353 None None] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:01:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 3e25766f-ccf8-435e-9d56-1f371d52bbcf {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "385a180f-e722-4826-a6e0-47608461e66e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "385a180f-e722-4826-a6e0-47608461e66e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received event network-changed-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Refreshing instance network info cache due to event network-changed-50e629ae-2997-44f7-985a-9f0b73c8e576. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] Acquiring lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] Acquired lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:01:41 user nova-compute[82522]: DEBUG nova.network.neutron [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Refreshing network info cache for port 50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:01:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updated VIF entry in instance network info cache for port 50e629ae-2997-44f7-985a-9f0b73c8e576. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:01:42 user nova-compute[82522]: DEBUG nova.network.neutron [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updating instance_info_cache with network_info: [{"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:01:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] Releasing lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:43 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:01:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:01:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:46 user nova-compute[82522]: DEBUG nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:01:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:46 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:01:46 user nova-compute[82522]: INFO nova.compute.claims [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Claim successful on node user
Apr 17 11:01:47 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:01:47 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:01:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:01:47 user nova-compute[82522]: INFO nova.virt.block_device [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Booting with volume dde2742a-8a42-448e-bb75-17865e262b98 at /dev/vda
Apr 17 11:01:47 user nova-compute[82522]: DEBUG nova.policy [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG os_brick.utils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3a2d93-1ba3-42e8-a749-a4974de30380]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f110f783-971e-4b74-8cfa-c14b6dafaa3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a56b0-e54b-4f81-bdab-5074cebdd024]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb4b5d5-847a-4894-8928-fb4f03bfb93d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:01:47 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 11:01:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e511bc9-e05f-4194-849f-af20572cb926]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG os_brick.utils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:01:47 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating existing volume attachment record: 4c42a91e-c562-4754-86cb-95cb9f8e5868 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 11:01:48 user nova-compute[82522]: DEBUG nova.network.neutron [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Successfully created port: 2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:01:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Successfully updated port: 2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:01:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:01:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:01:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:01:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-changed-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:01:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Refreshing instance network info cache due to event network-changed-2ddba1ca-b737-4b90-9348-3f302831a57f. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:01:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] Acquiring lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:01:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:01:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:50 user nova-compute[82522]: DEBUG nova.network.neutron [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating instance_info_cache with network_info: [{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:01:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:01:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Instance network_info: |[{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:01:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] Acquired lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:01:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Refreshing network info cache for port 2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:01:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updated VIF entry in instance network info cache for port 2ddba1ca-b737-4b90-9348-3f302831a57f. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:01:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating instance_info_cache with network_info: [{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:01:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] Releasing lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:01:52 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Creating image(s)
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Ensure instance console log exists: /opt/stack/data/nova/instances/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Start _get_guest_xml network_info=[{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '4c42a91e-c562-4754-86cb-95cb9f8e5868', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYBQCgMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'dde2742a-8a42-448e-bb75-17865e262b98', 'serial': 'dde2742a-8a42-448e-bb75-17865e262b98'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:01:52 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:01:52 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYBQCgMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:01:52 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:01:52 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:01:52 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf88c84c-8d19-476f-9079-82d50b18ac50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 11:01:52 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b6771b-e22f-4e5f-9870-f6d8ef647a51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98] added
Apr 17 11:01:52 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a668a8-1a92-4ea7-9494-c1a83115e756]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceb77dc-1ff6-4185-8aa2-8ac03e2f6017]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYBQCgMZ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYBQCgMZ" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed21f9-ea71-4700-85ce-e49bb4b55e87]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYBQCgMZ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec955d1-58c4-47c8-98e9-248c7eb39ae6]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0054e2aa-9065-4987-8023-85b3cf937126]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 17 11:01:52 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 17 11:01:52 user nova-compute[82522]:  {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:01:52 user nova-compute[82522]: WARNING os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 17 11:01:52 user nova-compute[82522]: 
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b9083-437b-465b-8d95-7e8499a19ecd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260]
Apr 17 11:01:52 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260] successful.
Apr 17 11:01:52 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a92fd4-3373-40c6-8db5-d6364cd03dba]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a8c15d-160a-4255-a8f3-3cdbb8476424]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:01:52 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:01:52 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd073f-cd8c-4d77-80f7-6ceda25155d5]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:01:52 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:01:53 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:01:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYBQCgMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 11:01:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:01:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26135396536373633', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:01:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135396536373633', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 11:01:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1546798760',display_name='tempest-ServerActionsTestJSON-server-1546798760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1546798760',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-ex0tt0mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:01:53 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:01:53 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG nova.objects.instance [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'pci_devices' on Instance uuid 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:01:54 user nova-compute[82522]:   <uuid>95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e</uuid>
Apr 17 11:01:54 user nova-compute[82522]:   <name>instance-00000026</name>
Apr 17 11:01:54 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:01:54 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:01:54 user nova-compute[82522]:   <metadata>
Apr 17 11:01:54 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:01:54 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:01:54 user nova-compute[82522]:       <nova:name>tempest-ServerActionsTestJSON-server-1546798760</nova:name>
Apr 17 11:01:54 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:01:52</nova:creationTime>
Apr 17 11:01:54 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:01:54 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:01:54 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:01:54 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:01:54 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:01:54 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:01:54 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:01:54 user nova-compute[82522]:       <nova:owner>
Apr 17 11:01:54 user nova-compute[82522]:         <nova:user uuid="a7e218d771db49e88d13d3b088f3d88a">tempest-ServerActionsTestJSON-2107442540-project-member</nova:user>
Apr 17 11:01:54 user nova-compute[82522]:         <nova:project uuid="cc1b39ff9581474b87c58164e5cafa00">tempest-ServerActionsTestJSON-2107442540</nova:project>
Apr 17 11:01:54 user nova-compute[82522]:       </nova:owner>
Apr 17 11:01:54 user nova-compute[82522]:       <nova:ports>
Apr 17 11:01:54 user nova-compute[82522]:         <nova:port uuid="2ddba1ca-b737-4b90-9348-3f302831a57f">
Apr 17 11:01:54 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 17 11:01:54 user nova-compute[82522]:         </nova:port>
Apr 17 11:01:54 user nova-compute[82522]:       </nova:ports>
Apr 17 11:01:54 user nova-compute[82522]:     </nova:instance>
Apr 17 11:01:54 user nova-compute[82522]:   </metadata>
Apr 17 11:01:54 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:01:54 user nova-compute[82522]:     <system>
Apr 17 11:01:54 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:01:54 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:01:54 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:01:54 user nova-compute[82522]:       <entry name="serial">95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e</entry>
Apr 17 11:01:54 user nova-compute[82522]:       <entry name="uuid">95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e</entry>
Apr 17 11:01:54 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:01:54 user nova-compute[82522]:     </system>
Apr 17 11:01:54 user nova-compute[82522]:   </sysinfo>
Apr 17 11:01:54 user nova-compute[82522]:   <os>
Apr 17 11:01:54 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:01:54 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:01:54 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:01:54 user nova-compute[82522]:   </os>
Apr 17 11:01:54 user nova-compute[82522]:   <features>
Apr 17 11:01:54 user nova-compute[82522]:     <acpi/>
Apr 17 11:01:54 user nova-compute[82522]:     <apic/>
Apr 17 11:01:54 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:01:54 user nova-compute[82522]:   </features>
Apr 17 11:01:54 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:01:54 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:01:54 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:01:54 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:01:54 user nova-compute[82522]:   </clock>
Apr 17 11:01:54 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:01:54 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:01:54 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:01:54 user nova-compute[82522]:   </cpu>
Apr 17 11:01:54 user nova-compute[82522]:   <devices>
Apr 17 11:01:54 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 11:01:54 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:01:54 user nova-compute[82522]:       <source dev="/dev/sdb"/>
Apr 17 11:01:54 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:01:54 user nova-compute[82522]:       <serial>dde2742a-8a42-448e-bb75-17865e262b98</serial>
Apr 17 11:01:54 user nova-compute[82522]:     </disk>
Apr 17 11:01:54 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:01:54 user nova-compute[82522]:       <mac address="fa:16:3e:9b:03:97"/>
Apr 17 11:01:54 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:01:54 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:01:54 user nova-compute[82522]:       <target dev="tap2ddba1ca-b7"/>
Apr 17 11:01:54 user nova-compute[82522]:     </interface>
Apr 17 11:01:54 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:01:54 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/console.log" append="off"/>
Apr 17 11:01:54 user nova-compute[82522]:     </serial>
Apr 17 11:01:54 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:01:54 user nova-compute[82522]:     <video>
Apr 17 11:01:54 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:01:54 user nova-compute[82522]:     </video>
Apr 17 11:01:54 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:01:54 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:01:54 user nova-compute[82522]:     </rng>
Apr 17 11:01:54 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:01:54 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:01:54 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:01:54 user nova-compute[82522]:     </memballoon>
Apr 17 11:01:54 user nova-compute[82522]:   </devices>
Apr 17 11:01:54 user nova-compute[82522]: </domain>
Apr 17 11:01:54 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1546798760',display_name='tempest-ServerActionsTestJSON-server-1546798760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1546798760',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-ex0tt0mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG os_vif [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ddba1ca-b7, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ddba1ca-b7, col_values=(('external_ids', {'iface-id': '2ddba1ca-b737-4b90-9348-3f302831a57f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:03:97', 'vm-uuid': '95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:54 user nova-compute[82522]: INFO os_vif [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7')
Apr 17 11:01:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:01:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No VIF found with MAC fa:16:3e:9b:03:97, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:01:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:01:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:01:55 user nova-compute[82522]: WARNING nova.compute.manager [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state building and task_state spawning.
Apr 17 11:01:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729317.4199684, 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:01:57 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] VM Resumed (Lifecycle Event)
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:01:57 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Instance spawned successfully.
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:01:57 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729317.4213321, 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:01:57 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] VM Started (Lifecycle Event)
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:01:57 user nova-compute[82522]: INFO nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Took 4.92 seconds to spawn the instance on the hypervisor.
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:01:57 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.compute.manager [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:57 user nova-compute[82522]: DEBUG nova.compute.manager [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:01:57 user nova-compute[82522]: WARNING nova.compute.manager [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state building and task_state spawning.
Apr 17 11:01:57 user nova-compute[82522]: INFO nova.compute.manager [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Took 10.68 seconds to build instance.
Apr 17 11:01:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.777s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:01:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:01:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:15 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:02:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:15 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:02:15 user nova-compute[82522]: INFO nova.compute.claims [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Claim successful on node user
Apr 17 11:02:16 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:02:16 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:02:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:02:16 user nova-compute[82522]: INFO nova.virt.block_device [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Booting with volume 32fcecef-5fb8-4df1-9e05-f988030c838f at /dev/vda
Apr 17 11:02:16 user nova-compute[82522]: DEBUG nova.policy [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG os_brick.utils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[272a983f-a044-4603-9bc2-3d0ec61237fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbf4ba1-41b3-4ff0-9836-b482d40510d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a146210-3d52-4ad3-8110-4a0f02016adc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[742d748f-93c6-442e-ab2f-8fbe4b7391b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:02:16 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 11:02:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40be36-f33a-46d0-9b68-5cf4fa0d7793]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG os_brick.utils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Updating existing volume attachment record: 356943db-8c6f-4340-b8ea-5528ec3f0038 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 11:02:16 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Successfully created port: 1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:02:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Successfully updated port: 1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:02:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:02:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquired lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:02:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:02:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received event network-changed-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:02:17 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Refreshing instance network info cache due to event network-changed-1ec35855-d3ca-49fe-8ea3-a810145ee9c8. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:02:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] Acquiring lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:02:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:02:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Updating instance_info_cache with network_info: [{"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:02:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Releasing lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:02:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Instance network_info: |[{"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:02:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] Acquired lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:02:18 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Refreshing network info cache for port 1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:02:18 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Updated VIF entry in instance network info cache for port 1ec35855-d3ca-49fe-8ea3-a810145ee9c8. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:02:18 user nova-compute[82522]: DEBUG nova.network.neutron [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Updating instance_info_cache with network_info: [{"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:02:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] Releasing lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:02:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:02:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Creating image(s)
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Ensure instance console log exists: /opt/stack/data/nova/instances/602fd731-58b4-42fc-abe5-8428f7ff0d1d/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Start _get_guest_xml network_info=[{"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '356943db-8c6f-4340-b8ea-5528ec3f0038', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huYkKzqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '602fd731-58b4-42fc-abe5-8428f7ff0d1d', 'attached_at': '', 'detached_at': '', 'volume_id': '32fcecef-5fb8-4df1-9e05-f988030c838f', 'serial': '32fcecef-5fb8-4df1-9e05-f988030c838f'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:02:21 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:02:21 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huYkKzqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:02:21 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:02:21 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:02:21 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a1486-d80a-494c-b45d-30d3fb9249fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 11:02:21 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ba11cc-2078-4700-b616-1becbe112dc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f] added
Apr 17 11:02:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4fe026-320c-4d43-b5ff-128384b6b43c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93bc752-5055-45ea-894d-750a2ad1471b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huYkKzqe {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huYkKzqe" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1199885-ce53-4b2a-8a8a-9eefe81eb8ff]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'huYkKzqe'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ddaa4e-1d2e-4537-8fd6-5b15eb1c0422]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f304c6-ad11-4dd8-91a1-fca08339c1c3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:02:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:02:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e583a-bc9a-4c5c-9832-631a644e4736]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260]
Apr 17 11:02:21 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260] successful.
Apr 17 11:02:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d225b9d4-41f4-4c33-89a1-c40505aadd89]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1c54c-f416-449e-9dcc-050cf7693490]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:02:21 user nova-compute[82522]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:02:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:02:21 user nova-compute[82522]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:02:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94118ec-2295-45be-a991-3176aaa33287]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:02:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huYkKzqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23765366234343537', 'path': '/dev/sdc'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765366234343537', 'path': '/dev/sdc'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-605051611',display_name='tempest-TestVolumeBootPattern-server-605051611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-605051611',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A==',key_name='tempest-TestVolumeBootPattern-44084031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-33atxggy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:02:16Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=602fd731-58b4-42fc-abe5-8428f7ff0d1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e9:63,bridge_name='br-int',has_traffic_filtering=True,id=1ec35855-d3ca-49fe-8ea3-a810145ee9c8,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec35855-d3') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'pci_devices' on Instance uuid 602fd731-58b4-42fc-abe5-8428f7ff0d1d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:02:22 user nova-compute[82522]:   <uuid>602fd731-58b4-42fc-abe5-8428f7ff0d1d</uuid>
Apr 17 11:02:22 user nova-compute[82522]:   <name>instance-00000027</name>
Apr 17 11:02:22 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:02:22 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:02:22 user nova-compute[82522]:   <metadata>
Apr 17 11:02:22 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:02:22 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:02:22 user nova-compute[82522]:       <nova:name>tempest-TestVolumeBootPattern-server-605051611</nova:name>
Apr 17 11:02:22 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:02:21</nova:creationTime>
Apr 17 11:02:22 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:02:22 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:02:22 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:02:22 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:02:22 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:02:22 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:02:22 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:02:22 user nova-compute[82522]:       <nova:owner>
Apr 17 11:02:22 user nova-compute[82522]:         <nova:user uuid="0e4ed1192974484bba2d4392f4d011c2">tempest-TestVolumeBootPattern-1777404437-project-member</nova:user>
Apr 17 11:02:22 user nova-compute[82522]:         <nova:project uuid="4fc3b8e3925847d48b522206a8875d3f">tempest-TestVolumeBootPattern-1777404437</nova:project>
Apr 17 11:02:22 user nova-compute[82522]:       </nova:owner>
Apr 17 11:02:22 user nova-compute[82522]:       <nova:ports>
Apr 17 11:02:22 user nova-compute[82522]:         <nova:port uuid="1ec35855-d3ca-49fe-8ea3-a810145ee9c8">
Apr 17 11:02:22 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 11:02:22 user nova-compute[82522]:         </nova:port>
Apr 17 11:02:22 user nova-compute[82522]:       </nova:ports>
Apr 17 11:02:22 user nova-compute[82522]:     </nova:instance>
Apr 17 11:02:22 user nova-compute[82522]:   </metadata>
Apr 17 11:02:22 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:02:22 user nova-compute[82522]:     <system>
Apr 17 11:02:22 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:02:22 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:02:22 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:02:22 user nova-compute[82522]:       <entry name="serial">602fd731-58b4-42fc-abe5-8428f7ff0d1d</entry>
Apr 17 11:02:22 user nova-compute[82522]:       <entry name="uuid">602fd731-58b4-42fc-abe5-8428f7ff0d1d</entry>
Apr 17 11:02:22 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:02:22 user nova-compute[82522]:     </system>
Apr 17 11:02:22 user nova-compute[82522]:   </sysinfo>
Apr 17 11:02:22 user nova-compute[82522]:   <os>
Apr 17 11:02:22 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:02:22 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:02:22 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:02:22 user nova-compute[82522]:   </os>
Apr 17 11:02:22 user nova-compute[82522]:   <features>
Apr 17 11:02:22 user nova-compute[82522]:     <acpi/>
Apr 17 11:02:22 user nova-compute[82522]:     <apic/>
Apr 17 11:02:22 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:02:22 user nova-compute[82522]:   </features>
Apr 17 11:02:22 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:02:22 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:02:22 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:02:22 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:02:22 user nova-compute[82522]:   </clock>
Apr 17 11:02:22 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:02:22 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:02:22 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:02:22 user nova-compute[82522]:   </cpu>
Apr 17 11:02:22 user nova-compute[82522]:   <devices>
Apr 17 11:02:22 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 11:02:22 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:02:22 user nova-compute[82522]:       <source dev="/dev/sdc"/>
Apr 17 11:02:22 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:02:22 user nova-compute[82522]:       <serial>32fcecef-5fb8-4df1-9e05-f988030c838f</serial>
Apr 17 11:02:22 user nova-compute[82522]:     </disk>
Apr 17 11:02:22 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:02:22 user nova-compute[82522]:       <mac address="fa:16:3e:1d:e9:63"/>
Apr 17 11:02:22 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:02:22 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:02:22 user nova-compute[82522]:       <target dev="tap1ec35855-d3"/>
Apr 17 11:02:22 user nova-compute[82522]:     </interface>
Apr 17 11:02:22 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:02:22 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/602fd731-58b4-42fc-abe5-8428f7ff0d1d/console.log" append="off"/>
Apr 17 11:02:22 user nova-compute[82522]:     </serial>
Apr 17 11:02:22 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:02:22 user nova-compute[82522]:     <video>
Apr 17 11:02:22 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:02:22 user nova-compute[82522]:     </video>
Apr 17 11:02:22 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:02:22 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:02:22 user nova-compute[82522]:     </rng>
Apr 17 11:02:22 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:02:22 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:02:22 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:02:22 user nova-compute[82522]:     </memballoon>
Apr 17 11:02:22 user nova-compute[82522]:   </devices>
Apr 17 11:02:22 user nova-compute[82522]: </domain>
Apr 17 11:02:22 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-605051611',display_name='tempest-TestVolumeBootPattern-server-605051611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-605051611',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A==',key_name='tempest-TestVolumeBootPattern-44084031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-33atxggy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:02:16Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=602fd731-58b4-42fc-abe5-8428f7ff0d1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e9:63,bridge_name='br-int',has_traffic_filtering=True,id=1ec35855-d3ca-49fe-8ea3-a810145ee9c8,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec35855-d3') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG os_vif [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e9:63,bridge_name='br-int',has_traffic_filtering=True,id=1ec35855-d3ca-49fe-8ea3-a810145ee9c8,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec35855-d3') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec35855-d3, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec35855-d3, col_values=(('external_ids', {'iface-id': '1ec35855-d3ca-49fe-8ea3-a810145ee9c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:e9:63', 'vm-uuid': '602fd731-58b4-42fc-abe5-8428f7ff0d1d'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:22 user nova-compute[82522]: INFO os_vif [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:e9:63,bridge_name='br-int',has_traffic_filtering=True,id=1ec35855-d3ca-49fe-8ea3-a810145ee9c8,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec35855-d3')
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:02:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No VIF found with MAC fa:16:3e:1d:e9:63, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received event network-vif-plugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] Acquiring lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] No waiting events found dispatching network-vif-plugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:02:24 user nova-compute[82522]: WARNING nova.compute.manager [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received unexpected event network-vif-plugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance with vm_state building and task_state spawning.
Apr 17 11:02:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729346.1524513, 602fd731-58b4-42fc-abe5-8428f7ff0d1d => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:02:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] VM Resumed (Lifecycle Event)
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:02:26 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Instance spawned successfully.
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:02:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729346.1557693, 602fd731-58b4-42fc-abe5-8428f7ff0d1d => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:02:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] VM Started (Lifecycle Event)
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:02:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:02:26 user nova-compute[82522]: INFO nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Took 4.98 seconds to spawn the instance on the hypervisor.
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received event network-vif-plugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] Acquiring lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] No waiting events found dispatching network-vif-plugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:02:26 user nova-compute[82522]: WARNING nova.compute.manager [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received unexpected event network-vif-plugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance with vm_state building and task_state spawning.
Apr 17 11:02:26 user nova-compute[82522]: INFO nova.compute.manager [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Took 10.55 seconds to build instance.
Apr 17 11:02:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.649s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:35 user nova-compute[82522]: INFO nova.compute.manager [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Unrescuing
Apr 17 11:02:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:02:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquired lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:02:35 user nova-compute[82522]: DEBUG nova.network.neutron [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:02:35 user nova-compute[82522]: DEBUG nova.network.neutron [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:02:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Releasing lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:02:35 user nova-compute[82522]: DEBUG nova.objects.instance [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'flavor' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:02:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-unplugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:02:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-unplugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:02:36 user nova-compute[82522]: WARNING nova.compute.manager [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-unplugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state rescued and task_state unrescuing.
Apr 17 11:02:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:36 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Instance destroyed successfully.
Apr 17 11:02:37 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:37 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:02:38 user nova-compute[82522]: WARNING nova.compute.manager [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state rescued and task_state unrescuing.
Apr 17 11:02:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:02:38 user nova-compute[82522]: WARNING nova.compute.manager [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state rescued and task_state unrescuing.
Apr 17 11:02:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:38 user nova-compute[82522]: DEBUG nova.compute.manager [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:02:38 user nova-compute[82522]: WARNING nova.compute.manager [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state rescued and task_state unrescuing.
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 11:02:39 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729359.9186168, 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:02:39 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] VM Resumed (Lifecycle Event)
Apr 17 11:02:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:02:40 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729359.9197512, 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:02:40 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] VM Started (Lifecycle Event)
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:02:40 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:02:40 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=26.29724884033203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:02:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:02:41 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:02:41 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:02:41 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:02:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:02:42 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:43 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:02:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:45 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:02:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:02:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:02:45 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:02:45 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updating instance_info_cache with network_info: [{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:02:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:02:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:02:46 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:02:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:02:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:02:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:03:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:03:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:03:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:03:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:03:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:03:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:03:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:03:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received event network-changed-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Refreshing instance network info cache due to event network-changed-50e629ae-2997-44f7-985a-9f0b73c8e576. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] Acquiring lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] Acquired lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:03:37 user nova-compute[82522]: DEBUG nova.network.neutron [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Refreshing network info cache for port 50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:03:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:03:38 user nova-compute[82522]: DEBUG nova.network.neutron [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updated VIF entry in instance network info cache for port 50e629ae-2997-44f7-985a-9f0b73c8e576. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:03:38 user nova-compute[82522]: DEBUG nova.network.neutron [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updating instance_info_cache with network_info: [{"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:03:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] Releasing lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG nova.compute.manager [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Stashing vm_state: active {{(pid=82522) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG nova.objects.instance [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'pci_requests' on Instance uuid 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:03:39 user nova-compute[82522]: INFO nova.compute.claims [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Claim successful on node user
Apr 17 11:03:39 user nova-compute[82522]: DEBUG nova.objects.instance [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'resources' on Instance uuid 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG nova.objects.instance [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'pci_devices' on Instance uuid 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:03:39 user nova-compute[82522]: INFO nova.compute.resource_tracker [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating resource usage from migration 3851768d-727d-4349-9b0d-8021d0ef8305
Apr 17 11:03:39 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.367s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:39 user nova-compute[82522]: INFO nova.compute.manager [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Migrating
Apr 17 11:03:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:03:39 user nova-compute[82522]: DEBUG nova.network.neutron [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-changed-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG nova.compute.manager [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Refreshing instance network info cache due to event network-changed-2ddba1ca-b737-4b90-9348-3f302831a57f. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] Acquiring lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG nova.network.neutron [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating instance_info_cache with network_info: [{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] Acquired lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG nova.network.neutron [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Refreshing network info cache for port 2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Starting migrate_disk_and_power_off {{(pid=82522) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-unplugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG nova.compute.manager [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-unplugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:03:41 user nova-compute[82522]: WARNING nova.compute.manager [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-unplugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state active and task_state resize_migrating.
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG nova.network.neutron [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updated VIF entry in instance network info cache for port 2ddba1ca-b737-4b90-9348-3f302831a57f. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG nova.network.neutron [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating instance_info_cache with network_info: [{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:41 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:03:41 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:03:41 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=26.314910888671875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:41 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Instance destroyed successfully.
Apr 17 11:03:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1546798760',display_name='tempest-ServerActionsTestJSON-server-1546798760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1546798760',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:01:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-ex0tt0mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:03:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:9b:03:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:9b:03:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG os_vif [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] Releasing lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ddba1ca-b7, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:03:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:42 user nova-compute[82522]: INFO os_vif [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7')
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYBQCgMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:03:42 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdbd7a1-69b3-4a05-83e2-73d5dc0dface]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 11:03:42 user nova-compute[82522]: No targets found.
Apr 17 11:03:42 user nova-compute[82522]: iSNS:
Apr 17 11:03:42 user nova-compute[82522]: No targets found.
Apr 17 11:03:42 user nova-compute[82522]: STATIC:
Apr 17 11:03:42 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98
Apr 17 11:03:42 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:03:42 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:03:42 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f
Apr 17 11:03:42 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:03:42 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:03:42 user nova-compute[82522]: FIRMWARE:
Apr 17 11:03:42 user nova-compute[82522]: No targets found.
Apr 17 11:03:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 11:03:42 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 11:03:42 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Applying migration context for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e as it has an incoming, in-progress migration 3851768d-727d-4349-9b0d-8021d0ef8305. Migration status is migrating {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 17 11:03:42 user nova-compute[82522]: INFO nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating resource usage from migration 3851768d-727d-4349-9b0d-8021d0ef8305
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd9ab4a-7f49-498f-af8f-f15ea960d2b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Migration 3851768d-727d-4349-9b0d-8021d0ef8305 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f170133b-09fd-4264-8e89-23932dae1c5c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:03:42 user nova-compute[82522]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:03:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:03:42 user nova-compute[82522]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:03:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7c7f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[05908a11-4dad-45fb-9a47-29318cab269c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[197d088c-0157-4de1-876d-7f4d5d4b2117]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7795c3a8-1c44-4c05-a5c4-72ce771ff2b5]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb47a91d-37aa-4db1-b8b4-6bc40da09ee5]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f732996-27d2-497d-b7cf-92966e169131]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f16caef-d5f1-4e29-91dc-476f51b94f3b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260]
Apr 17 11:03:42 user nova-compute[82522]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260] successful.
Apr 17 11:03:42 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbfafee-53d7-458e-a0b9-b4dcb35297b0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== disconnect_volume: return (342ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:03:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.network.neutron [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Port 2ddba1ca-b737-4b90-9348-3f302831a57f binding to destination host user is already ACTIVE {{(pid=82522) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:03:43 user nova-compute[82522]: WARNING nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state active and task_state resize_migrating.
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:03:43 user nova-compute[82522]: WARNING nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state active and task_state resize_migrating.
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:03:43 user nova-compute[82522]: WARNING nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state active and task_state resize_migrating.
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-unplugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-unplugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:03:43 user nova-compute[82522]: WARNING nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-unplugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state active and task_state resize_migrating.
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:03:43 user nova-compute[82522]: WARNING nova.compute.manager [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state active and task_state resize_migrating.
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:03:43 user nova-compute[82522]: DEBUG nova.network.neutron [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG nova.network.neutron [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating instance_info_cache with network_info: [{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG os_brick.utils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8029c7d2-9180-423b-bb2a-616009eca87f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9b44e6-1055-419e-a25f-931a69f90a8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae21ac-d0f7-490f-9047-3603ba9aefd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a886a0-4429-4c9e-bf65-d609a454607b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:03:44 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a254d7e-b491-42d0-9472-188090cb74b8]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG os_brick.utils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:03:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:03:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:03:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:03:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:03:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:03:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updating instance_info_cache with network_info: [{"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:03:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:03:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:03:48 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Starting finish_migration {{(pid=82522) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Instance directory exists: not creating {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 11:03:49 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Creating image(s)
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Ensure instance console log exists: /opt/stack/data/nova/instances/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Start _get_guest_xml network_info=[{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:9b:03:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '9e9943b3-6447-4776-8b32-0e0d64f04726', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYBQCgMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e', 'attached_at': '2023-04-17T11:03:49.000000', 'detached_at': '', 'volume_id': 'dde2742a-8a42-448e-bb75-17865e262b98', 'serial': 'dde2742a-8a42-448e-bb75-17865e262b98'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:03:49 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:03:49 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.objects.instance [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYBQCgMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:03:49 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:03:49 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:03:49 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a432af5-9161-4d5a-a499-f5c7d72e5a0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 11:03:49 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ef07c7-5154-445e-b322-46e0a355cd98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98] added
Apr 17 11:03:49 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ce76b7-ac16-40ca-9715-567605ba2a9e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba3e110-e274-4b19-8285-e68c8bffe253]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYBQCgMZ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYBQCgMZ" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73cf7a5-d692-4149-85e6-f3efbb564e59]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYBQCgMZ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1d5441-adde-4bb3-8571-208cd17bd9fc]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218fca5-6eb3-46b6-83d7-6cded2bcdedc]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:03:49 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:03:49 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a77b9-5194-4ea9-9cfc-e47204f9cdcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260]
Apr 17 11:03:49 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260] successful.
Apr 17 11:03:49 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f68b0d7-a789-4adb-bdc0-1558a334b39f]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3d3113-8829-4f56-8984-785cb66b77a4]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:03:49 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:03:49 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:03:49 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:03:49 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea7ab2c-2fa2-4ed5-8e6a-b9dfc1aa8dbd]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:03:49 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYBQCgMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26135396536373633', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135396536373633', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1546798760',display_name='tempest-ServerActionsTestJSON-server-1546798760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1546798760',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:01:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-ex0tt0mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:9b:03:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:9b:03:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:03:50 user nova-compute[82522]:   <uuid>95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e</uuid>
Apr 17 11:03:50 user nova-compute[82522]:   <name>instance-00000026</name>
Apr 17 11:03:50 user nova-compute[82522]:   <memory>196608</memory>
Apr 17 11:03:50 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:03:50 user nova-compute[82522]:   <metadata>
Apr 17 11:03:50 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:03:50 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:03:50 user nova-compute[82522]:       <nova:name>tempest-ServerActionsTestJSON-server-1546798760</nova:name>
Apr 17 11:03:50 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:03:49</nova:creationTime>
Apr 17 11:03:50 user nova-compute[82522]:       <nova:flavor name="m1.micro">
Apr 17 11:03:50 user nova-compute[82522]:         <nova:memory>192</nova:memory>
Apr 17 11:03:50 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:03:50 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:03:50 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:03:50 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:03:50 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:03:50 user nova-compute[82522]:       <nova:owner>
Apr 17 11:03:50 user nova-compute[82522]:         <nova:user uuid="a7e218d771db49e88d13d3b088f3d88a">tempest-ServerActionsTestJSON-2107442540-project-member</nova:user>
Apr 17 11:03:50 user nova-compute[82522]:         <nova:project uuid="cc1b39ff9581474b87c58164e5cafa00">tempest-ServerActionsTestJSON-2107442540</nova:project>
Apr 17 11:03:50 user nova-compute[82522]:       </nova:owner>
Apr 17 11:03:50 user nova-compute[82522]:       <nova:ports>
Apr 17 11:03:50 user nova-compute[82522]:         <nova:port uuid="2ddba1ca-b737-4b90-9348-3f302831a57f">
Apr 17 11:03:50 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 17 11:03:50 user nova-compute[82522]:         </nova:port>
Apr 17 11:03:50 user nova-compute[82522]:       </nova:ports>
Apr 17 11:03:50 user nova-compute[82522]:     </nova:instance>
Apr 17 11:03:50 user nova-compute[82522]:   </metadata>
Apr 17 11:03:50 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:03:50 user nova-compute[82522]:     <system>
Apr 17 11:03:50 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:03:50 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:03:50 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:03:50 user nova-compute[82522]:       <entry name="serial">95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e</entry>
Apr 17 11:03:50 user nova-compute[82522]:       <entry name="uuid">95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e</entry>
Apr 17 11:03:50 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:03:50 user nova-compute[82522]:     </system>
Apr 17 11:03:50 user nova-compute[82522]:   </sysinfo>
Apr 17 11:03:50 user nova-compute[82522]:   <os>
Apr 17 11:03:50 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:03:50 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:03:50 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:03:50 user nova-compute[82522]:   </os>
Apr 17 11:03:50 user nova-compute[82522]:   <features>
Apr 17 11:03:50 user nova-compute[82522]:     <acpi/>
Apr 17 11:03:50 user nova-compute[82522]:     <apic/>
Apr 17 11:03:50 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:03:50 user nova-compute[82522]:   </features>
Apr 17 11:03:50 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:03:50 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:03:50 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:03:50 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:03:50 user nova-compute[82522]:   </clock>
Apr 17 11:03:50 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:03:50 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:03:50 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:03:50 user nova-compute[82522]:   </cpu>
Apr 17 11:03:50 user nova-compute[82522]:   <devices>
Apr 17 11:03:50 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 11:03:50 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:03:50 user nova-compute[82522]:       <source dev="/dev/sdb"/>
Apr 17 11:03:50 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:03:50 user nova-compute[82522]:       <serial>dde2742a-8a42-448e-bb75-17865e262b98</serial>
Apr 17 11:03:50 user nova-compute[82522]:     </disk>
Apr 17 11:03:50 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:03:50 user nova-compute[82522]:       <mac address="fa:16:3e:9b:03:97"/>
Apr 17 11:03:50 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:03:50 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:03:50 user nova-compute[82522]:       <target dev="tap2ddba1ca-b7"/>
Apr 17 11:03:50 user nova-compute[82522]:     </interface>
Apr 17 11:03:50 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:03:50 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/console.log" append="off"/>
Apr 17 11:03:50 user nova-compute[82522]:     </serial>
Apr 17 11:03:50 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:03:50 user nova-compute[82522]:     <video>
Apr 17 11:03:50 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:03:50 user nova-compute[82522]:     </video>
Apr 17 11:03:50 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:03:50 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:03:50 user nova-compute[82522]:     </rng>
Apr 17 11:03:50 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:03:50 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:03:50 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:03:50 user nova-compute[82522]:     </memballoon>
Apr 17 11:03:50 user nova-compute[82522]:   </devices>
Apr 17 11:03:50 user nova-compute[82522]: </domain>
Apr 17 11:03:50 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1546798760',display_name='tempest-ServerActionsTestJSON-server-1546798760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1546798760',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:01:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-ex0tt0mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:9b:03:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1409463298-network", "vif_mac": "fa:16:3e:9b:03:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG os_vif [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ddba1ca-b7, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ddba1ca-b7, col_values=(('external_ids', {'iface-id': '2ddba1ca-b737-4b90-9348-3f302831a57f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:03:97', 'vm-uuid': '95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:50 user nova-compute[82522]: INFO os_vif [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7')
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:03:50 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] No VIF found with MAC fa:16:3e:9b:03:97, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:03:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:03:52 user nova-compute[82522]: WARNING nova.compute.manager [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state active and task_state resize_finish.
Apr 17 11:03:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 11:03:53 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729433.982883, 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:03:53 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] VM Resumed (Lifecycle Event)
Apr 17 11:03:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:03:53 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Instance running successfully.
Apr 17 11:03:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Failed to set time: agent not configured {{(pid=82522) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 17 11:03:53 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] finish_migration finished successfully. {{(pid=82522) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 17 11:03:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:03:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:03:54 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 17 11:03:54 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729433.9871047, 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:03:54 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] VM Started (Lifecycle Event)
Apr 17 11:03:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:03:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:03:54 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 17 11:03:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:03:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:03:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:03:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:03:54 user nova-compute[82522]: DEBUG nova.compute.manager [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:03:54 user nova-compute[82522]: WARNING nova.compute.manager [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state resized and task_state None.
Apr 17 11:03:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:03:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received event network-changed-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:04:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Refreshing instance network info cache due to event network-changed-1ec35855-d3ca-49fe-8ea3-a810145ee9c8. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:04:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] Acquiring lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:04:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] Acquired lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:04:07 user nova-compute[82522]: DEBUG nova.network.neutron [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Refreshing network info cache for port 1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:04:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Updated VIF entry in instance network info cache for port 1ec35855-d3ca-49fe-8ea3-a810145ee9c8. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:04:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Updating instance_info_cache with network_info: [{"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:04:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] Releasing lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:04:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "91012a2c-0ff4-4b71-a673-7739865ba48f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:04:16 user nova-compute[82522]: INFO nova.compute.claims [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Claim successful on node user
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.network.neutron [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:04:16 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:04:16 user nova-compute[82522]: INFO nova.virt.block_device [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Booting with volume e82762bd-edd9-4439-b3ee-c09fe883a407 at /dev/vda
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.policy [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG os_brick.utils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[94344221-4543-4ec2-b40d-3c537be945a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cad152-9403-48d3-b242-800b763bde47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d78c65f-5291-4f66-a862-4848b48fe0d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a929731-6d7c-4a5f-b742-eb3b8d00c738]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:04:16 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 11:04:16 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bc2384-3708-48aa-986a-516899a806e4]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG os_brick.utils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:04:16 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Updating existing volume attachment record: 0be6cb62-ec98-44d9-8a62-bd8adebf02c0 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 11:04:17 user nova-compute[82522]: DEBUG nova.network.neutron [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Successfully created port: e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Successfully updated port: e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquired lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received event network-changed-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Refreshing instance network info cache due to event network-changed-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] Acquiring lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG nova.network.neutron [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Updating instance_info_cache with network_info: [{"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Releasing lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Instance network_info: |[{"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] Acquired lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:04:18 user nova-compute[82522]: DEBUG nova.network.neutron [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Refreshing network info cache for port e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:04:19 user nova-compute[82522]: DEBUG nova.network.neutron [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Updated VIF entry in instance network info cache for port e1d8dd97-a6ef-499b-8bd6-ad45b3794df5. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:04:19 user nova-compute[82522]: DEBUG nova.network.neutron [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Updating instance_info_cache with network_info: [{"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:04:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] Releasing lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:04:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:04:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Creating image(s)
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Did not create local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Ensure instance console log exists: /opt/stack/data/nova/instances/91012a2c-0ff4-4b71-a673-7739865ba48f/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Start _get_guest_xml network_info=[{"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '0be6cb62-ec98-44d9-8a62-bd8adebf02c0', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myRgjYfd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '91012a2c-0ff4-4b71-a673-7739865ba48f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e82762bd-edd9-4439-b3ee-c09fe883a407', 'serial': 'e82762bd-edd9-4439-b3ee-c09fe883a407'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:04:21 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:04:21 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myRgjYfd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:04:21 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:04:21 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:04:21 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[23534013-9eb5-43e4-b3a2-2c45b2d04201]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 11:04:21 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[95500f63-f8c7-42b9-990d-0cc23bf04df4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407] added
Apr 17 11:04:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c683f71-e235-418d-91a2-87904e227f34]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafc6035-ae83-4754-8f47-585aed5bc65d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v myRgjYfd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v myRgjYfd" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd720fc-7dc9-4094-8b21-fd2af955128c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'myRgjYfd'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e1b88-4650-4220-b639-ce243b5de7f8]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80847b3-26d5-4859-8458-424f0dbc1fd8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:04:21 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:04:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:04:21 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:04:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d32da6-16e1-49f0-a98a-5504fa5b6f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407, portal: 172.16.0.220,3260]
Apr 17 11:04:21 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407, portal: 172.16.0.220,3260] successful.
Apr 17 11:04:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f67371-8352-49ab-abd0-fcb693a7af5b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ac62bc-490f-44de-a697-6c61181ca22f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:04:21 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:04:21 user nova-compute[82522]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 (non-flash)
Apr 17 11:04:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:04:21 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:04:21 user nova-compute[82522]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 (non-flash)
Apr 17 11:04:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[412dee88-fff3-4eec-b195-4be75e332e77]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:04:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myRgjYfd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23133366337653561', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133366337653561', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1491599674',display_name='tempest-TestVolumeBootPattern-server-1491599674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1491599674',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A==',key_name='tempest-TestVolumeBootPattern-44084031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-oolathkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:04:17Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=91012a2c-0ff4-4b71-a673-7739865ba48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b5:a7,bridge_name='br-int',has_traffic_filtering=True,id=e1d8dd97-a6ef-499b-8bd6-ad45b3794df5,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d8dd97-a6') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.objects.instance [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'pci_devices' on Instance uuid 91012a2c-0ff4-4b71-a673-7739865ba48f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:04:22 user nova-compute[82522]:   <uuid>91012a2c-0ff4-4b71-a673-7739865ba48f</uuid>
Apr 17 11:04:22 user nova-compute[82522]:   <name>instance-00000028</name>
Apr 17 11:04:22 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:04:22 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:04:22 user nova-compute[82522]:   <metadata>
Apr 17 11:04:22 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:04:22 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:04:22 user nova-compute[82522]:       <nova:name>tempest-TestVolumeBootPattern-server-1491599674</nova:name>
Apr 17 11:04:22 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:04:21</nova:creationTime>
Apr 17 11:04:22 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:04:22 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:04:22 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:04:22 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:04:22 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:04:22 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:04:22 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:04:22 user nova-compute[82522]:       <nova:owner>
Apr 17 11:04:22 user nova-compute[82522]:         <nova:user uuid="0e4ed1192974484bba2d4392f4d011c2">tempest-TestVolumeBootPattern-1777404437-project-member</nova:user>
Apr 17 11:04:22 user nova-compute[82522]:         <nova:project uuid="4fc3b8e3925847d48b522206a8875d3f">tempest-TestVolumeBootPattern-1777404437</nova:project>
Apr 17 11:04:22 user nova-compute[82522]:       </nova:owner>
Apr 17 11:04:22 user nova-compute[82522]:       <nova:ports>
Apr 17 11:04:22 user nova-compute[82522]:         <nova:port uuid="e1d8dd97-a6ef-499b-8bd6-ad45b3794df5">
Apr 17 11:04:22 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 17 11:04:22 user nova-compute[82522]:         </nova:port>
Apr 17 11:04:22 user nova-compute[82522]:       </nova:ports>
Apr 17 11:04:22 user nova-compute[82522]:     </nova:instance>
Apr 17 11:04:22 user nova-compute[82522]:   </metadata>
Apr 17 11:04:22 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:04:22 user nova-compute[82522]:     <system>
Apr 17 11:04:22 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:04:22 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:04:22 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:04:22 user nova-compute[82522]:       <entry name="serial">91012a2c-0ff4-4b71-a673-7739865ba48f</entry>
Apr 17 11:04:22 user nova-compute[82522]:       <entry name="uuid">91012a2c-0ff4-4b71-a673-7739865ba48f</entry>
Apr 17 11:04:22 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:04:22 user nova-compute[82522]:     </system>
Apr 17 11:04:22 user nova-compute[82522]:   </sysinfo>
Apr 17 11:04:22 user nova-compute[82522]:   <os>
Apr 17 11:04:22 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:04:22 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:04:22 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:04:22 user nova-compute[82522]:   </os>
Apr 17 11:04:22 user nova-compute[82522]:   <features>
Apr 17 11:04:22 user nova-compute[82522]:     <acpi/>
Apr 17 11:04:22 user nova-compute[82522]:     <apic/>
Apr 17 11:04:22 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:04:22 user nova-compute[82522]:   </features>
Apr 17 11:04:22 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:04:22 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:04:22 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:04:22 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:04:22 user nova-compute[82522]:   </clock>
Apr 17 11:04:22 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:04:22 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:04:22 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:04:22 user nova-compute[82522]:   </cpu>
Apr 17 11:04:22 user nova-compute[82522]:   <devices>
Apr 17 11:04:22 user nova-compute[82522]:     <disk type="block" device="disk">
Apr 17 11:04:22 user nova-compute[82522]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:04:22 user nova-compute[82522]:       <source dev="/dev/sdd"/>
Apr 17 11:04:22 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:04:22 user nova-compute[82522]:       <serial>e82762bd-edd9-4439-b3ee-c09fe883a407</serial>
Apr 17 11:04:22 user nova-compute[82522]:     </disk>
Apr 17 11:04:22 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:04:22 user nova-compute[82522]:       <mac address="fa:16:3e:a8:b5:a7"/>
Apr 17 11:04:22 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:04:22 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:04:22 user nova-compute[82522]:       <target dev="tape1d8dd97-a6"/>
Apr 17 11:04:22 user nova-compute[82522]:     </interface>
Apr 17 11:04:22 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:04:22 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/91012a2c-0ff4-4b71-a673-7739865ba48f/console.log" append="off"/>
Apr 17 11:04:22 user nova-compute[82522]:     </serial>
Apr 17 11:04:22 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:04:22 user nova-compute[82522]:     <video>
Apr 17 11:04:22 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:04:22 user nova-compute[82522]:     </video>
Apr 17 11:04:22 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:04:22 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:04:22 user nova-compute[82522]:     </rng>
Apr 17 11:04:22 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:04:22 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:04:22 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:04:22 user nova-compute[82522]:     </memballoon>
Apr 17 11:04:22 user nova-compute[82522]:   </devices>
Apr 17 11:04:22 user nova-compute[82522]: </domain>
Apr 17 11:04:22 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1491599674',display_name='tempest-TestVolumeBootPattern-server-1491599674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1491599674',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A==',key_name='tempest-TestVolumeBootPattern-44084031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-oolathkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:04:17Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=91012a2c-0ff4-4b71-a673-7739865ba48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b5:a7,bridge_name='br-int',has_traffic_filtering=True,id=e1d8dd97-a6ef-499b-8bd6-ad45b3794df5,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d8dd97-a6') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG os_vif [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b5:a7,bridge_name='br-int',has_traffic_filtering=True,id=e1d8dd97-a6ef-499b-8bd6-ad45b3794df5,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d8dd97-a6') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1d8dd97-a6, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1d8dd97-a6, col_values=(('external_ids', {'iface-id': 'e1d8dd97-a6ef-499b-8bd6-ad45b3794df5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:b5:a7', 'vm-uuid': '91012a2c-0ff4-4b71-a673-7739865ba48f'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:22 user nova-compute[82522]: INFO os_vif [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b5:a7,bridge_name='br-int',has_traffic_filtering=True,id=e1d8dd97-a6ef-499b-8bd6-ad45b3794df5,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d8dd97-a6')
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:04:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] No VIF found with MAC fa:16:3e:a8:b5:a7, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received event network-vif-plugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] Acquiring lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] No waiting events found dispatching network-vif-plugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:04:24 user nova-compute[82522]: WARNING nova.compute.manager [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received unexpected event network-vif-plugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance with vm_state building and task_state spawning.
Apr 17 11:04:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729466.3700666, 91012a2c-0ff4-4b71-a673-7739865ba48f => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:04:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] VM Resumed (Lifecycle Event)
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:04:26 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Instance spawned successfully.
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729466.3717234, 91012a2c-0ff4-4b71-a673-7739865ba48f => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:04:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] VM Started (Lifecycle Event)
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:04:26 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:04:26 user nova-compute[82522]: INFO nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Took 5.06 seconds to spawn the instance on the hypervisor.
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received event network-vif-plugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] Acquiring lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] No waiting events found dispatching network-vif-plugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:04:26 user nova-compute[82522]: WARNING nova.compute.manager [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received unexpected event network-vif-plugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance with vm_state building and task_state spawning.
Apr 17 11:04:26 user nova-compute[82522]: INFO nova.compute.manager [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Took 10.45 seconds to build instance.
Apr 17 11:04:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.557s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:04:31 user nova-compute[82522]: INFO nova.compute.claims [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Claim successful on node user
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:04:31 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.policy [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:04:31 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Creating image(s)
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk 1073741824" returned: 0 in 0.053s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Successfully created port: bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Cannot resize image /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'migration_context' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Ensure instance console log exists: /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Successfully updated port: bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquired lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-changed-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Refreshing instance network info cache due to event network-changed-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] Acquiring lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating instance_info_cache with network_info: [{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Releasing lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Instance network_info: |[{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] Acquired lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.neutron [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Refreshing network info cache for port bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Start _get_guest_xml network_info=[{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:04:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:04:33 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1289770639',display_name='tempest-ServerRescueNegativeTestJSON-server-1289770639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1289770639',id=41,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6bMYvwfR2NSZpa2Rl+5bZN+PeHM2NB1gHPlHIxTKr9aoqPNqunUDQK+9/cINh0G+oADlw0LFutBwblzU3KSmGbya/iJCiHB43XjPicDxDHVCt+iJIqTXDooiBKY1VBMQ==',key_name='tempest-keypair-1731392485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-af060vtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:04:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c15ce534a649ae8a971b33221e2500',uuid=d3ee5567-1a2d-4db4-8519-ba4308d8d3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb97f09f-c7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.objects.instance [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'pci_devices' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:04:33 user nova-compute[82522]:   <uuid>d3ee5567-1a2d-4db4-8519-ba4308d8d3b6</uuid>
Apr 17 11:04:33 user nova-compute[82522]:   <name>instance-00000029</name>
Apr 17 11:04:33 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:04:33 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:04:33 user nova-compute[82522]:   <metadata>
Apr 17 11:04:33 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:04:33 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:04:33 user nova-compute[82522]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1289770639</nova:name>
Apr 17 11:04:33 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:04:33</nova:creationTime>
Apr 17 11:04:33 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:04:33 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:04:33 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:04:33 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:04:33 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:04:33 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:04:33 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:04:33 user nova-compute[82522]:       <nova:owner>
Apr 17 11:04:33 user nova-compute[82522]:         <nova:user uuid="30c15ce534a649ae8a971b33221e2500">tempest-ServerRescueNegativeTestJSON-1988041396-project-member</nova:user>
Apr 17 11:04:33 user nova-compute[82522]:         <nova:project uuid="3747b7d3c6844772b0e6eed5299053ba">tempest-ServerRescueNegativeTestJSON-1988041396</nova:project>
Apr 17 11:04:33 user nova-compute[82522]:       </nova:owner>
Apr 17 11:04:33 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 11:04:33 user nova-compute[82522]:       <nova:ports>
Apr 17 11:04:33 user nova-compute[82522]:         <nova:port uuid="bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4">
Apr 17 11:04:33 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 17 11:04:33 user nova-compute[82522]:         </nova:port>
Apr 17 11:04:33 user nova-compute[82522]:       </nova:ports>
Apr 17 11:04:33 user nova-compute[82522]:     </nova:instance>
Apr 17 11:04:33 user nova-compute[82522]:   </metadata>
Apr 17 11:04:33 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:04:33 user nova-compute[82522]:     <system>
Apr 17 11:04:33 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:04:33 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:04:33 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:04:33 user nova-compute[82522]:       <entry name="serial">d3ee5567-1a2d-4db4-8519-ba4308d8d3b6</entry>
Apr 17 11:04:33 user nova-compute[82522]:       <entry name="uuid">d3ee5567-1a2d-4db4-8519-ba4308d8d3b6</entry>
Apr 17 11:04:33 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:04:33 user nova-compute[82522]:     </system>
Apr 17 11:04:33 user nova-compute[82522]:   </sysinfo>
Apr 17 11:04:33 user nova-compute[82522]:   <os>
Apr 17 11:04:33 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:04:33 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:04:33 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:04:33 user nova-compute[82522]:   </os>
Apr 17 11:04:33 user nova-compute[82522]:   <features>
Apr 17 11:04:33 user nova-compute[82522]:     <acpi/>
Apr 17 11:04:33 user nova-compute[82522]:     <apic/>
Apr 17 11:04:33 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:04:33 user nova-compute[82522]:   </features>
Apr 17 11:04:33 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:04:33 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:04:33 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:04:33 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:04:33 user nova-compute[82522]:   </clock>
Apr 17 11:04:33 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:04:33 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:04:33 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:04:33 user nova-compute[82522]:   </cpu>
Apr 17 11:04:33 user nova-compute[82522]:   <devices>
Apr 17 11:04:33 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:04:33 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:04:33 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk"/>
Apr 17 11:04:33 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:04:33 user nova-compute[82522]:     </disk>
Apr 17 11:04:33 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:04:33 user nova-compute[82522]:       <mac address="fa:16:3e:ae:ed:3d"/>
Apr 17 11:04:33 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:04:33 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:04:33 user nova-compute[82522]:       <target dev="tapbb97f09f-c7"/>
Apr 17 11:04:33 user nova-compute[82522]:     </interface>
Apr 17 11:04:33 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:04:33 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/console.log" append="off"/>
Apr 17 11:04:33 user nova-compute[82522]:     </serial>
Apr 17 11:04:33 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:04:33 user nova-compute[82522]:     <video>
Apr 17 11:04:33 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:04:33 user nova-compute[82522]:     </video>
Apr 17 11:04:33 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:04:33 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:04:33 user nova-compute[82522]:     </rng>
Apr 17 11:04:33 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:04:33 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:04:33 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:04:33 user nova-compute[82522]:     </memballoon>
Apr 17 11:04:33 user nova-compute[82522]:   </devices>
Apr 17 11:04:33 user nova-compute[82522]: </domain>
Apr 17 11:04:33 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1289770639',display_name='tempest-ServerRescueNegativeTestJSON-server-1289770639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1289770639',id=41,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6bMYvwfR2NSZpa2Rl+5bZN+PeHM2NB1gHPlHIxTKr9aoqPNqunUDQK+9/cINh0G+oADlw0LFutBwblzU3KSmGbya/iJCiHB43XjPicDxDHVCt+iJIqTXDooiBKY1VBMQ==',key_name='tempest-keypair-1731392485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-af060vtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:04:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c15ce534a649ae8a971b33221e2500',uuid=d3ee5567-1a2d-4db4-8519-ba4308d8d3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb97f09f-c7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG os_vif [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb97f09f-c7') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb97f09f-c7, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb97f09f-c7, col_values=(('external_ids', {'iface-id': 'bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:ed:3d', 'vm-uuid': 'd3ee5567-1a2d-4db4-8519-ba4308d8d3b6'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:33 user nova-compute[82522]: INFO os_vif [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb97f09f-c7')
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No VIF found with MAC fa:16:3e:ae:ed:3d, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.neutron [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updated VIF entry in instance network info cache for port bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG nova.network.neutron [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating instance_info_cache with network_info: [{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:04:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] Releasing lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:04:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:04:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:04:35 user nova-compute[82522]: WARNING nova.compute.manager [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state building and task_state spawning.
Apr 17 11:04:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:36 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729476.9641845, d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:04:36 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] VM Resumed (Lifecycle Event)
Apr 17 11:04:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:04:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:04:36 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Instance spawned successfully.
Apr 17 11:04:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:04:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:04:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:04:37 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729476.966913, d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:04:37 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] VM Started (Lifecycle Event)
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:04:37 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:04:37 user nova-compute[82522]: INFO nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Took 5.32 seconds to spawn the instance on the hypervisor.
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:04:37 user nova-compute[82522]: WARNING nova.compute.manager [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state building and task_state spawning.
Apr 17 11:04:37 user nova-compute[82522]: INFO nova.compute.manager [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Took 6.00 seconds to build instance.
Apr 17 11:04:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.094s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:04:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:04:42 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:04:42 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=26.30274200439453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Applying migration context for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e as it has an incoming, in-progress migration 3851768d-727d-4349-9b0d-8021d0ef8305. Migration status is finished {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 17 11:04:42 user nova-compute[82522]: INFO nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating resource usage from migration 3851768d-727d-4349-9b0d-8021d0ef8305
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Migration 3851768d-727d-4349-9b0d-8021d0ef8305 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 91012a2c-0ff4-4b71-a673-7739865ba48f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:04:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:04:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:44 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:04:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:04:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:52 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:04:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:04:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:05:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:05:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:05:29 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Going to confirm migration 2 {{(pid=82522) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 17 11:05:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:05:29 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquired lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:05:29 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:05:29 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'info_cache' on Instance uuid 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:05:30 user nova-compute[82522]: DEBUG nova.network.neutron [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating instance_info_cache with network_info: [{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:05:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Releasing lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:05:30 user nova-compute[82522]: DEBUG nova.objects.instance [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'migration_context' on Instance uuid 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:05:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:05:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:05:30 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:05:30 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:05:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.342s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:05:30 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Deleted allocation for migration 3851768d-727d-4349-9b0d-8021d0ef8305
Apr 17 11:05:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.533s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:05:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:05:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:05:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:05:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:05:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:38 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:05:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:05:42 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:05:42 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8283MB free_disk=26.282390594482422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 91012a2c-0ff4-4b71-a673-7739865ba48f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 11:05:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:44 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:05:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:05:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:05:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:05:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:05:48 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updating instance_info_cache with network_info: [{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:05:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:05:48 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:05:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:05:52 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:05:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:05:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:06:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:06:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received event network-changed-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Refreshing instance network info cache due to event network-changed-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:06:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] Acquiring lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:06:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] Acquired lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:06:07 user nova-compute[82522]: DEBUG nova.network.neutron [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Refreshing network info cache for port e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Updated VIF entry in instance network info cache for port e1d8dd97-a6ef-499b-8bd6-ad45b3794df5. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Updating instance_info_cache with network_info: [{"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] Releasing lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received event network-changed-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Refreshing instance network info cache due to event network-changed-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] Acquiring lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] Acquired lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG nova.network.neutron [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Refreshing network info cache for port e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "91012a2c-0ff4-4b71-a673-7739865ba48f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:08 user nova-compute[82522]: INFO nova.compute.manager [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Terminating instance
Apr 17 11:06:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:06:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG nova.network.neutron [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Updated VIF entry in instance network info cache for port e1d8dd97-a6ef-499b-8bd6-ad45b3794df5. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG nova.network.neutron [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Updating instance_info_cache with network_info: [{"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] Releasing lock "refresh_cache-91012a2c-0ff4-4b71-a673-7739865ba48f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:06:09 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Instance destroyed successfully.
Apr 17 11:06:09 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'resources' on Instance uuid 91012a2c-0ff4-4b71-a673-7739865ba48f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1491599674',display_name='tempest-TestVolumeBootPattern-server-1491599674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1491599674',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A==',key_name='tempest-TestVolumeBootPattern-44084031',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:04:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-oolathkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:04:27Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=91012a2c-0ff4-4b71-a673-7739865ba48f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "address": "fa:16:3e:a8:b5:a7", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d8dd97-a6", "ovs_interfaceid": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b5:a7,bridge_name='br-int',has_traffic_filtering=True,id=e1d8dd97-a6ef-499b-8bd6-ad45b3794df5,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d8dd97-a6') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_vif [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b5:a7,bridge_name='br-int',has_traffic_filtering=True,id=e1d8dd97-a6ef-499b-8bd6-ad45b3794df5,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d8dd97-a6') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1d8dd97-a6, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:06:09 user nova-compute[82522]: INFO os_vif [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b5:a7,bridge_name='br-int',has_traffic_filtering=True,id=e1d8dd97-a6ef-499b-8bd6-ad45b3794df5,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d8dd97-a6')
Apr 17 11:06:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myRgjYfd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:06:09 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7daf9d-92ef-4a53-90b7-43fc90e7b70b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 11:06:09 user nova-compute[82522]: No targets found.
Apr 17 11:06:09 user nova-compute[82522]: iSNS:
Apr 17 11:06:09 user nova-compute[82522]: No targets found.
Apr 17 11:06:09 user nova-compute[82522]: STATIC:
Apr 17 11:06:09 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98
Apr 17 11:06:09 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:06:09 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:06:09 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f
Apr 17 11:06:09 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:06:09 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:06:09 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407
Apr 17 11:06:09 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:06:09 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:06:09 user nova-compute[82522]: FIRMWARE:
Apr 17 11:06:09 user nova-compute[82522]: No targets found.
Apr 17 11:06:09 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 11:06:09 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 11:06:09 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[23513c6f-6942-4b09-8504-40e8d384db08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e89d32-686e-4114-9bdf-528d3cd30e92]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:06:09 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:06:09 user nova-compute[82522]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 (non-flash)
Apr 17 11:06:09 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:06:09 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:06:09 user nova-compute[82522]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 (non-flash)
Apr 17 11:06:09 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa264f00e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407'): ({'sdd'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Removing single pathed devices sdd {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[332cea60-02dd-493a-a86d-c8b1f3b82b22]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d38bc7d-2625-412f-b416-67f1f6683f1c]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flushing IO for device /dev/sdd {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0be19dd-786e-4e65-82ef-0d5bbd6c0dc1]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2238bf-f00c-4b94-b503-1a058a832099]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23133366337653561', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_60ee8199', '/dev/disk/by-id/scsi-1SCST_BIO60ee8199-136c7e5acde228b3') {{(pid=92652) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c28deaa-35cb-4e7a-b80e-2f91238c5fa5]: (4, None) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44427d6-b30d-4541-90e3-839f4826ecb9]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[858075cb-794e-4c25-85b2-c3fbbe6ee3a9]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407, portal: 172.16.0.220,3260]
Apr 17 11:06:10 user nova-compute[82522]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407, portal: 172.16.0.220,3260] successful.
Apr 17 11:06:10 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82762bd-edd9-4439-b3ee-c09fe883a407 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f31014d-ddd5-4087-8d1c-47616eb82e19]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== disconnect_volume: return (350ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 11:06:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Deleting instance files /opt/stack/data/nova/instances/91012a2c-0ff4-4b71-a673-7739865ba48f_del
Apr 17 11:06:10 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Deletion of /opt/stack/data/nova/instances/91012a2c-0ff4-4b71-a673-7739865ba48f_del complete
Apr 17 11:06:10 user nova-compute[82522]: INFO nova.compute.manager [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:06:10 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Took 0.49 seconds to deallocate network for instance.
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-7eeb074d-67ab-4cee-bf51-7cc398b0ac7c req-b42ae358-6094-4ecd-9814-f0e83dadb95c service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received event network-vif-deleted-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received event network-vif-unplugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Acquiring lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] No waiting events found dispatching network-vif-unplugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received event network-vif-unplugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received event network-vif-plugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Acquiring lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:10 user nova-compute[82522]: DEBUG nova.compute.manager [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] No waiting events found dispatching network-vif-plugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:06:10 user nova-compute[82522]: WARNING nova.compute.manager [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Received unexpected event network-vif-plugged-e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance with vm_state active and task_state deleting.
Apr 17 11:06:11 user nova-compute[82522]: INFO nova.compute.manager [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Took 0.81 seconds to detach 1 volumes for instance.
Apr 17 11:06:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:11 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:06:11 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:06:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:11 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Deleted allocations for instance 91012a2c-0ff4-4b71-a673-7739865ba48f
Apr 17 11:06:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "91012a2c-0ff4-4b71-a673-7739865ba48f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.988s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-changed-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG nova.compute.manager [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Refreshing instance network info cache due to event network-changed-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] Acquiring lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] Acquired lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG nova.network.neutron [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Refreshing network info cache for port bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'flavor' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:22 user nova-compute[82522]: INFO nova.compute.manager [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Attaching volume 9884dc01-fc15-48b8-935e-eef5420d68b1 to /dev/vdb
Apr 17 11:06:22 user nova-compute[82522]: DEBUG os_brick.utils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2cb91b-52c6-407c-b7d1-4e6eb27ff629]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53b2569-e420-46a3-ab9c-1e07236b6867]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aff8d63-94cd-4981-a271-1440318d9f59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95ba014-0c82-4fe5-a86b-0741f59edc39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:06:22 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c243cad4-b37b-4e62-8228-f699158bacc0]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG os_brick.utils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating existing volume attachment record: 91641bd0-c49b-4494-91dd-fac38633932d {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG nova.network.neutron [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updated VIF entry in instance network info cache for port bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG nova.network.neutron [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating instance_info_cache with network_info: [{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:06:22 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] Releasing lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:06:24 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729569.6399267, 91012a2c-0ff4-4b71-a673-7739865ba48f => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:06:24 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] VM Stopped (Lifecycle Event)
Apr 17 11:06:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:24 user nova-compute[82522]: DEBUG nova.compute.manager [None req-07944a11-f44d-446e-b3c6-7dcdc6791c22 None None] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:06:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:29 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 11:06:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'otBXfyEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:06:29 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:06:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:06:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:06:29 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:06:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:06:29 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:06:29 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 11:06:29 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a409d0c-be63-4dab-9dd9-44390640a44a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 11:06:30 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[31065a90-a64c-4a0b-8b9d-afd21c9b14b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1] added
Apr 17 11:06:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419fd04-be4d-454c-a864-58ebf5ebff74]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de664fe-55b5-4d68-9d22-c7daaec4283d]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v otBXfyEG {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v otBXfyEG" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b321670a-9af4-49d5-a556-9e13adcb1432]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'otBXfyEG'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d84f255-57dc-429d-bda4-27f86bdb27eb]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b740607a-8124-4141-aed9-d2fe95f8e32b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:06:30 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:06:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:06:30 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:06:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05b387f-c4cd-431f-a3bb-b2d2e68225a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1, portal: 172.16.0.220,3260]
Apr 17 11:06:30 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1, portal: 172.16.0.220,3260] successful.
Apr 17 11:06:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[397f5f90-7905-4afa-b065-035da5162bbb]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11fb9d2-dbc4-418a-9f72-628e6def3984]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:06:30 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:06:30 user nova-compute[82522]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)
Apr 17 11:06:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:06:30 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:06:30 user nova-compute[82522]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)
Apr 17 11:06:30 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fada2e-11d5-4208-9d0a-a52b60501fe7]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:06:30 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'otBXfyEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26639323865666531', 'path': '/dev/sdd'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639323865666531', 'path': '/dev/sdd'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'flavor' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 11:06:31 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:06:31 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 11:06:31 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:06:31 user nova-compute[82522]:   <serial>9884dc01-fc15-48b8-935e-eef5420d68b1</serial>
Apr 17 11:06:31 user nova-compute[82522]: </disk>
Apr 17 11:06:31 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:06:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No VIF found with MAC fa:16:3e:ae:ed:3d, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:06:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.493s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:32 user nova-compute[82522]: INFO nova.compute.manager [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Rescuing
Apr 17 11:06:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:06:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquired lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:06:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG nova.network.neutron [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating instance_info_cache with network_info: [{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Releasing lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-unplugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG nova.compute.manager [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-unplugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:06:33 user nova-compute[82522]: WARNING nova.compute.manager [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-unplugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state active and task_state rescuing.
Apr 17 11:06:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:34 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Instance destroyed successfully.
Apr 17 11:06:34 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Attempting rescue
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82522) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Instance directory exists: not creating {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 11:06:34 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Creating image(s)
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue" returned: 0 in 0.050s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'migration_context' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Start _get_guest_xml network_info=[{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "vif_mac": "fa:16:3e:ae:ed:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '66764afd-311a-41a0-a068-b2937b23acba', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'resources' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'numa_topology' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:06:34 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:06:34 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1289770639',display_name='tempest-ServerRescueNegativeTestJSON-server-1289770639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1289770639',id=41,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6bMYvwfR2NSZpa2Rl+5bZN+PeHM2NB1gHPlHIxTKr9aoqPNqunUDQK+9/cINh0G+oADlw0LFutBwblzU3KSmGbya/iJCiHB43XjPicDxDHVCt+iJIqTXDooiBKY1VBMQ==',key_name='tempest-keypair-1731392485',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-af060vtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:04:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c15ce534a649ae8a971b33221e2500',uuid=d3ee5567-1a2d-4db4-8519-ba4308d8d3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "vif_mac": "fa:16:3e:ae:ed:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "vif_mac": "fa:16:3e:ae:ed:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ed:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb97f09f-c7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.objects.instance [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'pci_devices' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:06:34 user nova-compute[82522]:   <uuid>d3ee5567-1a2d-4db4-8519-ba4308d8d3b6</uuid>
Apr 17 11:06:34 user nova-compute[82522]:   <name>instance-00000029</name>
Apr 17 11:06:34 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:06:34 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:06:34 user nova-compute[82522]:   <metadata>
Apr 17 11:06:34 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:06:34 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:06:34 user nova-compute[82522]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1289770639</nova:name>
Apr 17 11:06:34 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:06:34</nova:creationTime>
Apr 17 11:06:34 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:06:34 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:06:34 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:06:34 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:06:34 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:06:34 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:06:34 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:06:34 user nova-compute[82522]:       <nova:owner>
Apr 17 11:06:34 user nova-compute[82522]:         <nova:user uuid="30c15ce534a649ae8a971b33221e2500">tempest-ServerRescueNegativeTestJSON-1988041396-project-member</nova:user>
Apr 17 11:06:34 user nova-compute[82522]:         <nova:project uuid="3747b7d3c6844772b0e6eed5299053ba">tempest-ServerRescueNegativeTestJSON-1988041396</nova:project>
Apr 17 11:06:34 user nova-compute[82522]:       </nova:owner>
Apr 17 11:06:34 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 11:06:34 user nova-compute[82522]:       <nova:ports>
Apr 17 11:06:34 user nova-compute[82522]:         <nova:port uuid="bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4">
Apr 17 11:06:34 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 17 11:06:34 user nova-compute[82522]:         </nova:port>
Apr 17 11:06:34 user nova-compute[82522]:       </nova:ports>
Apr 17 11:06:34 user nova-compute[82522]:     </nova:instance>
Apr 17 11:06:34 user nova-compute[82522]:   </metadata>
Apr 17 11:06:34 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:06:34 user nova-compute[82522]:     <system>
Apr 17 11:06:34 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:06:34 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:06:34 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:06:34 user nova-compute[82522]:       <entry name="serial">d3ee5567-1a2d-4db4-8519-ba4308d8d3b6</entry>
Apr 17 11:06:34 user nova-compute[82522]:       <entry name="uuid">d3ee5567-1a2d-4db4-8519-ba4308d8d3b6</entry>
Apr 17 11:06:34 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:06:34 user nova-compute[82522]:     </system>
Apr 17 11:06:34 user nova-compute[82522]:   </sysinfo>
Apr 17 11:06:34 user nova-compute[82522]:   <os>
Apr 17 11:06:34 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:06:34 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:06:34 user nova-compute[82522]:   </os>
Apr 17 11:06:34 user nova-compute[82522]:   <features>
Apr 17 11:06:34 user nova-compute[82522]:     <acpi/>
Apr 17 11:06:34 user nova-compute[82522]:     <apic/>
Apr 17 11:06:34 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:06:34 user nova-compute[82522]:   </features>
Apr 17 11:06:34 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:06:34 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:06:34 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:06:34 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:06:34 user nova-compute[82522]:   </clock>
Apr 17 11:06:34 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:06:34 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:06:34 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:06:34 user nova-compute[82522]:   </cpu>
Apr 17 11:06:34 user nova-compute[82522]:   <devices>
Apr 17 11:06:34 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:06:34 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:06:34 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue"/>
Apr 17 11:06:34 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:06:34 user nova-compute[82522]:     </disk>
Apr 17 11:06:34 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:06:34 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:06:34 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk"/>
Apr 17 11:06:34 user nova-compute[82522]:       <target dev="vdb" bus="virtio"/>
Apr 17 11:06:34 user nova-compute[82522]:     </disk>
Apr 17 11:06:34 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:06:34 user nova-compute[82522]:       <mac address="fa:16:3e:ae:ed:3d"/>
Apr 17 11:06:34 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:06:34 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:06:34 user nova-compute[82522]:       <target dev="tapbb97f09f-c7"/>
Apr 17 11:06:34 user nova-compute[82522]:     </interface>
Apr 17 11:06:34 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:06:34 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/console.log" append="off"/>
Apr 17 11:06:34 user nova-compute[82522]:     </serial>
Apr 17 11:06:34 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:06:34 user nova-compute[82522]:     <video>
Apr 17 11:06:34 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:06:34 user nova-compute[82522]:     </video>
Apr 17 11:06:34 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:06:34 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:06:34 user nova-compute[82522]:     </rng>
Apr 17 11:06:34 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:06:34 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:06:34 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:06:34 user nova-compute[82522]:     </memballoon>
Apr 17 11:06:34 user nova-compute[82522]:   </devices>
Apr 17 11:06:34 user nova-compute[82522]: </domain>
Apr 17 11:06:34 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:06:34 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Instance destroyed successfully.
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] No VIF found with MAC fa:16:3e:ae:ed:3d, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:06:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:35 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:35 user nova-compute[82522]: DEBUG nova.compute.manager [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:06:35 user nova-compute[82522]: WARNING nova.compute.manager [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state active and task_state rescuing.
Apr 17 11:06:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:06:37 user nova-compute[82522]: WARNING nova.compute.manager [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state active and task_state rescuing.
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:06:37 user nova-compute[82522]: WARNING nova.compute.manager [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state active and task_state rescuing.
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729597.9324753, d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:06:37 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] VM Resumed (Lifecycle Event)
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:06:37 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 17 11:06:37 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729597.9342911, d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:06:37 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] VM Started (Lifecycle Event)
Apr 17 11:06:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:06:38 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:06:39 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:40 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:06:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:06:42 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:06:42 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8405MB free_disk=26.280254364013672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:06:42 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:06:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:06:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:06:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:06:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:06:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:45 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:06:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:06:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:06:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:06:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:06:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updating instance_info_cache with network_info: [{"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:06:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-3e25766f-ccf8-435e-9d56-1f371d52bbcf" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:06:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:06:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:51 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:06:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:06:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received event network-changed-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Refreshing instance network info cache due to event network-changed-1ec35855-d3ca-49fe-8ea3-a810145ee9c8. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] Acquiring lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] Acquired lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG nova.network.neutron [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Refreshing network info cache for port 1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:07:06 user nova-compute[82522]: INFO nova.compute.manager [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Terminating instance
Apr 17 11:07:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received event network-vif-unplugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] Acquiring lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] No waiting events found dispatching network-vif-unplugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received event network-vif-unplugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.network.neutron [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Updated VIF entry in instance network info cache for port 1ec35855-d3ca-49fe-8ea3-a810145ee9c8. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.network.neutron [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Updating instance_info_cache with network_info: [{"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] Releasing lock "refresh_cache-602fd731-58b4-42fc-abe5-8428f7ff0d1d" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:07:07 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Instance destroyed successfully.
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.objects.instance [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lazy-loading 'resources' on Instance uuid 602fd731-58b4-42fc-abe5-8428f7ff0d1d {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-605051611',display_name='tempest-TestVolumeBootPattern-server-605051611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-605051611',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A==',key_name='tempest-TestVolumeBootPattern-44084031',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fc3b8e3925847d48b522206a8875d3f',ramdisk_id='',reservation_id='r-33atxggy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1777404437',owner_user_name='tempest-TestVolumeBootPattern-1777404437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:02:26Z,user_data=None,user_id='0e4ed1192974484bba2d4392f4d011c2',uuid=602fd731-58b4-42fc-abe5-8428f7ff0d1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converting VIF {"id": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "address": "fa:16:3e:1d:e9:63", "network": {"id": "b2fc1cd4-860e-4abd-8e33-e797799c466f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1780696384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc3b8e3925847d48b522206a8875d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec35855-d3", "ovs_interfaceid": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:e9:63,bridge_name='br-int',has_traffic_filtering=True,id=1ec35855-d3ca-49fe-8ea3-a810145ee9c8,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec35855-d3') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_vif [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:e9:63,bridge_name='br-int',has_traffic_filtering=True,id=1ec35855-d3ca-49fe-8ea3-a810145ee9c8,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec35855-d3') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec35855-d3, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:07:07 user nova-compute[82522]: INFO os_vif [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:e9:63,bridge_name='br-int',has_traffic_filtering=True,id=1ec35855-d3ca-49fe-8ea3-a810145ee9c8,network=Network(b2fc1cd4-860e-4abd-8e33-e797799c466f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec35855-d3')
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huYkKzqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:07:07 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b71e63-b8b3-412a-be07-e26bd580c56c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 11:07:07 user nova-compute[82522]: No targets found.
Apr 17 11:07:07 user nova-compute[82522]: iSNS:
Apr 17 11:07:07 user nova-compute[82522]: No targets found.
Apr 17 11:07:07 user nova-compute[82522]: STATIC:
Apr 17 11:07:07 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1
Apr 17 11:07:07 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:07:07 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:07:07 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98
Apr 17 11:07:07 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:07:07 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:07:07 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f
Apr 17 11:07:07 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:07:07 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:07:07 user nova-compute[82522]: FIRMWARE:
Apr 17 11:07:07 user nova-compute[82522]: No targets found.
Apr 17 11:07:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 11:07:07 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 11:07:07 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5630e5c7-e61a-4abc-b687-637ba701a7f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad2c5d-65b2-448a-9f09-39e045cb2847]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:07:07 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:07:07 user nova-compute[82522]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)
Apr 17 11:07:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f (non-flash)
Apr 17 11:07:07 user nova-compute[82522]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:07:07 user nova-compute[82522]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)
Apr 17 11:07:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2846cbe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f'): ({'sdc'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Removing single pathed devices sdc {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988109b-f340-4a9c-a488-bc69e28732a2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b58487-f29e-4f7f-8b52-9c02ce19d48b]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flushing IO for device /dev/sdc {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[788ad72f-d303-4540-a4be-e26a5d2fb705]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.069s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ffb4e6-9611-47bc-b53e-7c1af0163fd4]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] SCSI volumes sdc have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcc7380b-7e6b4457d9aa72b0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cc7380b', '/dev/disk/by-id/scsi-23765366234343537') {{(pid=92652) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcaa706-036a-44d2-9392-3a55952e449f]: (4, None) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cadf24-ca66-46d6-9798-7e3264702bf1]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d878b932-705e-4804-80ce-d7ab499cace3]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260]
Apr 17 11:07:07 user nova-compute[82522]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f, portal: 172.16.0.220,3260] successful.
Apr 17 11:07:07 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fcecef-5fb8-4df1-9e05-f988030c838f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a78ac0-945c-46ef-bb1c-18a595d6a86b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] <== disconnect_volume: return (340ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 11:07:07 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Deleting instance files /opt/stack/data/nova/instances/602fd731-58b4-42fc-abe5-8428f7ff0d1d_del
Apr 17 11:07:07 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Deletion of /opt/stack/data/nova/instances/602fd731-58b4-42fc-abe5-8428f7ff0d1d_del complete
Apr 17 11:07:07 user nova-compute[82522]: INFO nova.compute.manager [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 17 11:07:07 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:07:07 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:07:08 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:07:08 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Took 0.54 seconds to deallocate network for instance.
Apr 17 11:07:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received event network-vif-plugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:07:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] Acquiring lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:07:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:07:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:07:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] No waiting events found dispatching network-vif-plugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:07:09 user nova-compute[82522]: WARNING nova.compute.manager [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received unexpected event network-vif-plugged-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance with vm_state active and task_state deleting.
Apr 17 11:07:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Received event network-vif-deleted-1ec35855-d3ca-49fe-8ea3-a810145ee9c8 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:07:09 user nova-compute[82522]: INFO nova.compute.manager [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Took 0.77 seconds to detach 1 volumes for instance.
Apr 17 11:07:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:07:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:07:09 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:07:09 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:07:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:07:09 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Deleted allocations for instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d
Apr 17 11:07:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "602fd731-58b4-42fc-abe5-8428f7ff0d1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.952s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:07:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:07:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:07:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:07:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:07:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:20 user nova-compute[82522]: INFO nova.compute.manager [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Get console output
Apr 17 11:07:20 user nova-compute[82522]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 17 11:07:22 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729627.389897, 602fd731-58b4-42fc-abe5-8428f7ff0d1d => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:07:22 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] VM Stopped (Lifecycle Event)
Apr 17 11:07:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-d4e86e53-1643-4340-acf8-621aed4258b1 None None] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:07:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:40 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:41 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:07:42 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:07:43 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:07:43 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8448MB free_disk=26.260406494140625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:07:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:07:45 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:07:45 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:07:46 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:07:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:07:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:07:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:07:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:07:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:07:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:07:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:07:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:07:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating instance_info_cache with network_info: [{"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:07:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:07:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:07:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:53 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:07:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:07:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:20 user nova-compute[82522]: INFO nova.compute.manager [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Terminating instance
Apr 17 11:08:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:08:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-unplugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-unplugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-unplugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:21 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Instance destroyed successfully.
Apr 17 11:08:21 user nova-compute[82522]: DEBUG nova.objects.instance [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'resources' on Instance uuid 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1546798760',display_name='tempest-ServerActionsTestJSON-server-1546798760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1546798760',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-ex0tt0mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "2ddba1ca-b737-4b90-9348-3f302831a57f", "address": "fa:16:3e:9b:03:97", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddba1ca-b7", "ovs_interfaceid": "2ddba1ca-b737-4b90-9348-3f302831a57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_vif [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ddba1ca-b7, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:21 user nova-compute[82522]: INFO os_vif [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:03:97,bridge_name='br-int',has_traffic_filtering=True,id=2ddba1ca-b737-4b90-9348-3f302831a57f,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddba1ca-b7')
Apr 17 11:08:21 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYBQCgMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:08:21 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e21df7b-6017-4c4c-a806-50ae5106895e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 11:08:21 user nova-compute[82522]: No targets found.
Apr 17 11:08:21 user nova-compute[82522]: iSNS:
Apr 17 11:08:21 user nova-compute[82522]: No targets found.
Apr 17 11:08:21 user nova-compute[82522]: STATIC:
Apr 17 11:08:21 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1
Apr 17 11:08:21 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:08:21 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:08:21 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98
Apr 17 11:08:21 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:08:21 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:08:21 user nova-compute[82522]: FIRMWARE:
Apr 17 11:08:21 user nova-compute[82522]: No targets found.
Apr 17 11:08:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 11:08:21 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 11:08:21 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[01058d76-0727-4d2c-8dc3-a978c0f8888d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ed746-0e59-4613-a76c-4fb718f58b0a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:08:21 user nova-compute[82522]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)
Apr 17 11:08:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 (non-flash)
Apr 17 11:08:21 user nova-compute[82522]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)
Apr 17 11:08:21 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2a471edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c19c9e-f297-4f42-aad3-4c4c83709c93]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0640350d-7529-4655-ae98-81242c4d8e74]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee5699b-9f91-4503-a6e8-a96d7a928084]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[63634a02-3b55-44ed-a237-6c82333186e3]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26135396536373633', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3af6c857', '/dev/disk/by-id/scsi-1SCST_BIO3af6c857-a59e6763be8a4ad5') {{(pid=92652) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabd6f08-6c17-49e8-b59b-12d5a1a2c226]: (4, None) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04ce502-15cf-4963-97d0-c55a31c70aec]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:08:21 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fc9bea-cc55-4bea-9d9b-ab64d996b062]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260]
Apr 17 11:08:22 user nova-compute[82522]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98, portal: 172.16.0.220,3260] successful.
Apr 17 11:08:22 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde2742a-8a42-448e-bb75-17865e262b98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[791a337a-0c3c-4152-ab71-1eeaa3470fca]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] <== disconnect_volume: return (318ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 11:08:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Deleting instance files /opt/stack/data/nova/instances/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e_del
Apr 17 11:08:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Deletion of /opt/stack/data/nova/instances/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e_del complete
Apr 17 11:08:22 user nova-compute[82522]: INFO nova.compute.manager [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 17 11:08:22 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:08:22 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:08:22 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Took 0.85 seconds to deallocate network for instance.
Apr 17 11:08:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:08:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] Acquiring lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] No waiting events found dispatching network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:08:23 user nova-compute[82522]: WARNING nova.compute.manager [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received unexpected event network-vif-plugged-2ddba1ca-b737-4b90-9348-3f302831a57f for instance with vm_state active and task_state deleting.
Apr 17 11:08:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Received event network-vif-deleted-2ddba1ca-b737-4b90-9348-3f302831a57f {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:08:23 user nova-compute[82522]: INFO nova.compute.manager [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Unrescuing
Apr 17 11:08:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:08:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquired lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:08:23 user nova-compute[82522]: DEBUG nova.network.neutron [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:08:23 user nova-compute[82522]: INFO nova.compute.manager [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Took 0.80 seconds to detach 1 volumes for instance.
Apr 17 11:08:23 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Deleting volume: dde2742a-8a42-448e-bb75-17865e262b98 {{(pid=82522) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 17 11:08:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG nova.network.neutron [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating instance_info_cache with network_info: [{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Releasing lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG nova.objects.instance [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'flavor' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:24 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Deleted allocations for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e
Apr 17 11:08:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.286s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-unplugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:24 user nova-compute[82522]: DEBUG nova.compute.manager [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-unplugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:08:24 user nova-compute[82522]: WARNING nova.compute.manager [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-unplugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state rescued and task_state unrescuing.
Apr 17 11:08:24 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Instance destroyed successfully.
Apr 17 11:08:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:08:26 user nova-compute[82522]: WARNING nova.compute.manager [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state rescued and task_state unrescuing.
Apr 17 11:08:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:08:26 user nova-compute[82522]: WARNING nova.compute.manager [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state rescued and task_state unrescuing.
Apr 17 11:08:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.virt.libvirt.host [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Removed pending event for d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 due to event {{(pid=82522) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729708.2608733, d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:08:28 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] VM Resumed (Lifecycle Event)
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:08:28 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729708.2647588, d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:08:28 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] VM Started (Lifecycle Event)
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:08:28 user nova-compute[82522]: WARNING nova.compute.manager [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state active and task_state None.
Apr 17 11:08:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:36 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729701.670002, 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:08:36 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] VM Stopped (Lifecycle Event)
Apr 17 11:08:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b8652531-50ba-470e-b299-806703f20a2e None None] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:08:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:41 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:08:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:08:42 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:08:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:45 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:08:45 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=26.276100158691406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:08:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:08:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:48 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:08:48 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:08:48 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:08:48 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:08:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:08:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:08:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:08:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:08:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:08:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:49 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating instance_info_cache with network_info: [{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:08:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:08:49 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:08:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:55 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:08:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:08:59 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:09:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:09:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:09:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:09:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:09:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:09:11 user nova-compute[82522]: INFO nova.compute.manager [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Terminating instance
Apr 17 11:09:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:09:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received event network-vif-unplugged-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] Acquiring lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] No waiting events found dispatching network-vif-unplugged-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG nova.compute.manager [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received event network-vif-unplugged-50e629ae-2997-44f7-985a-9f0b73c8e576 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:12 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Instance destroyed successfully.
Apr 17 11:09:12 user nova-compute[82522]: DEBUG nova.objects.instance [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'resources' on Instance uuid 3e25766f-ccf8-435e-9d56-1f371d52bbcf {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-455400217',display_name='tempest-ServerActionsTestJSON-server-455400217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-455400217',id=37,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w==',key_name='tempest-keypair-681910651',keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc1b39ff9581474b87c58164e5cafa00',ramdisk_id='',reservation_id='r-4cnvgred',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2107442540',owner_user_name='tempest-ServerActionsTestJSON-2107442540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7e218d771db49e88d13d3b088f3d88a',uuid=3e25766f-ccf8-435e-9d56-1f371d52bbcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converting VIF {"id": "50e629ae-2997-44f7-985a-9f0b73c8e576", "address": "fa:16:3e:44:7c:82", "network": {"id": "b6f8ce20-6af1-47a1-8b12-a5be609289ec", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1409463298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1b39ff9581474b87c58164e5cafa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e629ae-29", "ovs_interfaceid": "50e629ae-2997-44f7-985a-9f0b73c8e576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:7c:82,bridge_name='br-int',has_traffic_filtering=True,id=50e629ae-2997-44f7-985a-9f0b73c8e576,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e629ae-29') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG os_vif [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:7c:82,bridge_name='br-int',has_traffic_filtering=True,id=50e629ae-2997-44f7-985a-9f0b73c8e576,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e629ae-29') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50e629ae-29, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:09:12 user nova-compute[82522]: INFO os_vif [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:7c:82,bridge_name='br-int',has_traffic_filtering=True,id=50e629ae-2997-44f7-985a-9f0b73c8e576,network=Network(b6f8ce20-6af1-47a1-8b12-a5be609289ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e629ae-29')
Apr 17 11:09:12 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Deleting instance files /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf_del
Apr 17 11:09:12 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Deletion of /opt/stack/data/nova/instances/3e25766f-ccf8-435e-9d56-1f371d52bbcf_del complete
Apr 17 11:09:12 user nova-compute[82522]: INFO nova.compute.manager [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 17 11:09:12 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:09:12 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:09:13 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:09:13 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Took 0.78 seconds to deallocate network for instance.
Apr 17 11:09:13 user nova-compute[82522]: DEBUG nova.compute.manager [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received event network-vif-deleted-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:09:13 user nova-compute[82522]: INFO nova.compute.manager [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Neutron deleted interface 50e629ae-2997-44f7-985a-9f0b73c8e576; detaching it from the instance and deleting it from the info cache
Apr 17 11:09:13 user nova-compute[82522]: DEBUG nova.network.neutron [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:09:13 user nova-compute[82522]: DEBUG nova.compute.manager [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Detach interface failed, port_id=50e629ae-2997-44f7-985a-9f0b73c8e576, reason: Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 11:09:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:09:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:09:13 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:09:13 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:09:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:09:13 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Deleted allocations for instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf
Apr 17 11:09:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.801s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:09:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received event network-vif-plugged-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:09:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] Acquiring lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:09:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:09:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] Lock "3e25766f-ccf8-435e-9d56-1f371d52bbcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:09:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] No waiting events found dispatching network-vif-plugged-50e629ae-2997-44f7-985a-9f0b73c8e576 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:09:14 user nova-compute[82522]: WARNING nova.compute.manager [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Received unexpected event network-vif-plugged-50e629ae-2997-44f7-985a-9f0b73c8e576 for instance with vm_state deleted and task_state None.
Apr 17 11:09:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:09:27 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729752.3340106, 3e25766f-ccf8-435e-9d56-1f371d52bbcf => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:09:27 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] VM Stopped (Lifecycle Event)
Apr 17 11:09:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-6ad6d130-81d9-4b68-92ca-3da3a727bd23 None None] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:09:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:09:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:09:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:09:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:09:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:09:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:09:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:09:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:09:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:09:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:44 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:09:44 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:09:44 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=26.29465103149414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:09:44 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:09:45 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:09:45 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:09:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:09:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:09:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:09:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:48 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:09:48 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:09:48 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:09:48 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:09:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:09:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:09:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:09:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:09:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:09:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:09:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:09:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Verify base images {{(pid=82522) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Image id 66764afd-311a-41a0-a068-b2937b23acba yields fingerprint 45e0d896a326a0fee71aedd708b2e06e56cfc853 {{(pid=82522) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] image 66764afd-311a-41a0-a068-b2937b23acba at (/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853): checking
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] image 66764afd-311a-41a0-a068-b2937b23acba at (/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853): image is in use {{(pid=82522) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=82522) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 is a valid instance name {{(pid=82522) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 has a disk file {{(pid=82522) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 is backed by 45e0d896a326a0fee71aedd708b2e06e56cfc853 {{(pid=82522) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] 385a180f-e722-4826-a6e0-47608461e66e is a valid instance name {{(pid=82522) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] 385a180f-e722-4826-a6e0-47608461e66e has a disk file {{(pid=82522) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e is backed by 45e0d896a326a0fee71aedd708b2e06e56cfc853 {{(pid=82522) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f is a valid instance name {{(pid=82522) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f has a disk file {{(pid=82522) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f is backed by 45e0d896a326a0fee71aedd708b2e06e56cfc853 {{(pid=82522) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 11:10:09 user nova-compute[82522]: WARNING nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Unknown base file: /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd
Apr 17 11:10:09 user nova-compute[82522]: WARNING nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03
Apr 17 11:10:09 user nova-compute[82522]: WARNING nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da
Apr 17 11:10:09 user nova-compute[82522]: WARNING nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Unknown base file: /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3
Apr 17 11:10:09 user nova-compute[82522]: WARNING nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc
Apr 17 11:10:09 user nova-compute[82522]: WARNING nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603
Apr 17 11:10:09 user nova-compute[82522]: WARNING nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Unknown base file: /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e
Apr 17 11:10:09 user nova-compute[82522]: WARNING nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284
Apr 17 11:10:09 user nova-compute[82522]: WARNING nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Active base files: /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Removable base files: /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03 /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3 /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603 /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284 /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/67b0db3dbe0a00c281659fa21006f6da5d073fbd
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e33d901a9af14bd0316200c7decc3e350dd2ff03
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5bf740b60e3000cf6a600bf7aab69bdf5f20b6da
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/efaccf0df7ddc7bd6383cf333477ac17303729d3
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dc7180832b7bcf2f1502792958782d9adb6df2cc
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6b14d485e7094f32e62c9e308213c631849e7603
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/46adc6ffd7a0bca521644c244cd2ef2f0dd5438e
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8f89c096ce7bce3a99ad56932220e1a2413ff284
Apr 17 11:10:09 user nova-compute[82522]: INFO nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7aa7490ac52546426e90fd39c257c63406716938
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Verification complete {{(pid=82522) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Verify swap images {{(pid=82522) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG nova.virt.libvirt.imagecache [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Verify ephemeral images {{(pid=82522) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 17 11:10:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:16 user nova-compute[82522]: DEBUG nova.compute.manager [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-changed-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:10:16 user nova-compute[82522]: DEBUG nova.compute.manager [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Refreshing instance network info cache due to event network-changed-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:10:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] Acquiring lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:10:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] Acquired lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:10:16 user nova-compute[82522]: DEBUG nova.network.neutron [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Refreshing network info cache for port bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:10:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:16 user nova-compute[82522]: INFO nova.compute.manager [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Detaching volume 9884dc01-fc15-48b8-935e-eef5420d68b1
Apr 17 11:10:16 user nova-compute[82522]: INFO nova.virt.block_device [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Attempting to driver detach volume 9884dc01-fc15-48b8-935e-eef5420d68b1 from mountpoint /dev/vdb
Apr 17 11:10:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Attempting to detach device vdb from instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 11:10:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 11:10:16 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:10:16 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 11:10:16 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:10:16 user nova-compute[82522]:   <serial>9884dc01-fc15-48b8-935e-eef5420d68b1</serial>
Apr 17 11:10:16 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 11:10:16 user nova-compute[82522]: </disk>
Apr 17 11:10:16 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 11:10:16 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Successfully detached device vdb from instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 from the persistent domain config.
Apr 17 11:10:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 11:10:16 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 11:10:16 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:10:16 user nova-compute[82522]:   <source dev="/dev/sdd"/>
Apr 17 11:10:16 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:10:16 user nova-compute[82522]:   <serial>9884dc01-fc15-48b8-935e-eef5420d68b1</serial>
Apr 17 11:10:16 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 11:10:16 user nova-compute[82522]: </disk>
Apr 17 11:10:16 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG nova.network.neutron [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updated VIF entry in instance network info cache for port bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG nova.network.neutron [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating instance_info_cache with network_info: [{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] Releasing lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681729817.217655, d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 11:10:17 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Successfully detached device vdb from instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 from the live domain config.
Apr 17 11:10:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'otBXfyEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:10:17 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a8e941-bf00-466f-94b7-e29afd85dda0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 11:10:17 user nova-compute[82522]: No targets found.
Apr 17 11:10:17 user nova-compute[82522]: iSNS:
Apr 17 11:10:17 user nova-compute[82522]: No targets found.
Apr 17 11:10:17 user nova-compute[82522]: STATIC:
Apr 17 11:10:17 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1
Apr 17 11:10:17 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:10:17 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:10:17 user nova-compute[82522]: FIRMWARE:
Apr 17 11:10:17 user nova-compute[82522]: No targets found.
Apr 17 11:10:17 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 11:10:17 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 11:10:17 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92b4c48-6b53-4bbd-9c92-5a2a2cfc21fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4746b9cd-7441-4ea1-84f1-b91b87cbd94f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)
Apr 17 11:10:17 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 (non-flash)
Apr 17 11:10:17 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa28455c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1'): ({'sdd'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Removing single pathed devices sdd {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a4344f-0b9b-4b06-ae30-c02f51e49634]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b35de2-77cd-4282-addf-f1cc3cb17ea1]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flushing IO for device /dev/sdd {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a2a081-e8e3-4b5c-9c12-ce04290ae1d3]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[260512b3-4135-46b6-b51a-ae535e7b8165]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] SCSI volumes sdd have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f07badc-ea60-4591-9cde-d5544c89d7e0]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e54fa7-eee4-4bb4-955f-280f5b50f372]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1, portal: 172.16.0.220,3260]
Apr 17 11:10:17 user nova-compute[82522]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1, portal: 172.16.0.220,3260] successful.
Apr 17 11:10:17 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9884dc01-fc15-48b8-935e-eef5420d68b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5d2b2f-4841-4857-81f4-e2f1720c1f05]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] <== disconnect_volume: return (286ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:10:17 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 11:10:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-changed-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:10:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Refreshing instance network info cache due to event network-changed-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:10:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] Acquiring lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:10:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] Acquired lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:10:18 user nova-compute[82522]: DEBUG nova.network.neutron [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Refreshing network info cache for port bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:10:18 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'flavor' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:10:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.926s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:19 user nova-compute[82522]: DEBUG nova.network.neutron [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updated VIF entry in instance network info cache for port bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:10:19 user nova-compute[82522]: DEBUG nova.network.neutron [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating instance_info_cache with network_info: [{"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:10:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] Releasing lock "refresh_cache-d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:10:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:24 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:10:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:24 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:24 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:10:24 user nova-compute[82522]: INFO nova.compute.claims [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Claim successful on node user
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:10:25 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.policy [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:10:25 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Creating image(s)
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "/opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "/opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "/opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk 1073741824" returned: 0 in 0.087s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.151s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 11:10:25 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Successfully created port: 8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Cannot resize image /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'migration_context' on Instance uuid 027f1645-6991-4726-b1f4-2728db710061 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Ensure instance console log exists: /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Successfully updated port: 8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquired lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received event network-changed-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.compute.manager [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Refreshing instance network info cache due to event network-changed-8c280312-1554-4ee3-aadd-aa4929fecbda. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] Acquiring lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:10:26 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.network.neutron [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updating instance_info_cache with network_info: [{"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Releasing lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Instance network_info: |[{"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] Acquired lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.network.neutron [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Refreshing network info cache for port 8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Start _get_guest_xml network_info=[{"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:10:27 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:10:27 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1924403157',display_name='tempest-AttachVolumeNegativeTest-server-1924403157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1924403157',id=42,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ04c7v86JHMXBmJMTmyNeA0qqN/cuBpmzV6m2UWiAkn3llbc6tHPrkAHzr1XTDzkYeypgUcGkGVFUIPNX7q3NKjpvG9aPeS89G8eGq6TwkmjxrkSFdaRb8QjNiIPT6IDg==',key_name='tempest-keypair-1469598392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-j0jeatie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=027f1645-6991-4726-b1f4-2728db710061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d6:ff,bridge_name='br-int',has_traffic_filtering=True,id=8c280312-1554-4ee3-aadd-aa4929fecbda,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c280312-15') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.objects.instance [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'pci_devices' on Instance uuid 027f1645-6991-4726-b1f4-2728db710061 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:10:27 user nova-compute[82522]:   <uuid>027f1645-6991-4726-b1f4-2728db710061</uuid>
Apr 17 11:10:27 user nova-compute[82522]:   <name>instance-0000002a</name>
Apr 17 11:10:27 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:10:27 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:10:27 user nova-compute[82522]:   <metadata>
Apr 17 11:10:27 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:10:27 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:10:27 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1924403157</nova:name>
Apr 17 11:10:27 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:10:27</nova:creationTime>
Apr 17 11:10:27 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:10:27 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:10:27 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:10:27 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:10:27 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:10:27 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:10:27 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:10:27 user nova-compute[82522]:       <nova:owner>
Apr 17 11:10:27 user nova-compute[82522]:         <nova:user uuid="8fc272a75798487d84beedfa65775423">tempest-AttachVolumeNegativeTest-60160992-project-member</nova:user>
Apr 17 11:10:27 user nova-compute[82522]:         <nova:project uuid="64eccc3b86914e4ab735b79c4b53a142">tempest-AttachVolumeNegativeTest-60160992</nova:project>
Apr 17 11:10:27 user nova-compute[82522]:       </nova:owner>
Apr 17 11:10:27 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 11:10:27 user nova-compute[82522]:       <nova:ports>
Apr 17 11:10:27 user nova-compute[82522]:         <nova:port uuid="8c280312-1554-4ee3-aadd-aa4929fecbda">
Apr 17 11:10:27 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 17 11:10:27 user nova-compute[82522]:         </nova:port>
Apr 17 11:10:27 user nova-compute[82522]:       </nova:ports>
Apr 17 11:10:27 user nova-compute[82522]:     </nova:instance>
Apr 17 11:10:27 user nova-compute[82522]:   </metadata>
Apr 17 11:10:27 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:10:27 user nova-compute[82522]:     <system>
Apr 17 11:10:27 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:10:27 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:10:27 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:10:27 user nova-compute[82522]:       <entry name="serial">027f1645-6991-4726-b1f4-2728db710061</entry>
Apr 17 11:10:27 user nova-compute[82522]:       <entry name="uuid">027f1645-6991-4726-b1f4-2728db710061</entry>
Apr 17 11:10:27 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:10:27 user nova-compute[82522]:     </system>
Apr 17 11:10:27 user nova-compute[82522]:   </sysinfo>
Apr 17 11:10:27 user nova-compute[82522]:   <os>
Apr 17 11:10:27 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:10:27 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:10:27 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:10:27 user nova-compute[82522]:   </os>
Apr 17 11:10:27 user nova-compute[82522]:   <features>
Apr 17 11:10:27 user nova-compute[82522]:     <acpi/>
Apr 17 11:10:27 user nova-compute[82522]:     <apic/>
Apr 17 11:10:27 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:10:27 user nova-compute[82522]:   </features>
Apr 17 11:10:27 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:10:27 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:10:27 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:10:27 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:10:27 user nova-compute[82522]:   </clock>
Apr 17 11:10:27 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:10:27 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:10:27 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:10:27 user nova-compute[82522]:   </cpu>
Apr 17 11:10:27 user nova-compute[82522]:   <devices>
Apr 17 11:10:27 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:10:27 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:10:27 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk"/>
Apr 17 11:10:27 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:10:27 user nova-compute[82522]:     </disk>
Apr 17 11:10:27 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:10:27 user nova-compute[82522]:       <mac address="fa:16:3e:32:d6:ff"/>
Apr 17 11:10:27 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:10:27 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:10:27 user nova-compute[82522]:       <target dev="tap8c280312-15"/>
Apr 17 11:10:27 user nova-compute[82522]:     </interface>
Apr 17 11:10:27 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:10:27 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/console.log" append="off"/>
Apr 17 11:10:27 user nova-compute[82522]:     </serial>
Apr 17 11:10:27 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:10:27 user nova-compute[82522]:     <video>
Apr 17 11:10:27 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:10:27 user nova-compute[82522]:     </video>
Apr 17 11:10:27 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:10:27 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:10:27 user nova-compute[82522]:     </rng>
Apr 17 11:10:27 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:10:27 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:10:27 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:10:27 user nova-compute[82522]:     </memballoon>
Apr 17 11:10:27 user nova-compute[82522]:   </devices>
Apr 17 11:10:27 user nova-compute[82522]: </domain>
Apr 17 11:10:27 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1924403157',display_name='tempest-AttachVolumeNegativeTest-server-1924403157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1924403157',id=42,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ04c7v86JHMXBmJMTmyNeA0qqN/cuBpmzV6m2UWiAkn3llbc6tHPrkAHzr1XTDzkYeypgUcGkGVFUIPNX7q3NKjpvG9aPeS89G8eGq6TwkmjxrkSFdaRb8QjNiIPT6IDg==',key_name='tempest-keypair-1469598392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-j0jeatie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=027f1645-6991-4726-b1f4-2728db710061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d6:ff,bridge_name='br-int',has_traffic_filtering=True,id=8c280312-1554-4ee3-aadd-aa4929fecbda,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c280312-15') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG os_vif [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d6:ff,bridge_name='br-int',has_traffic_filtering=True,id=8c280312-1554-4ee3-aadd-aa4929fecbda,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c280312-15') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c280312-15, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c280312-15, col_values=(('external_ids', {'iface-id': '8c280312-1554-4ee3-aadd-aa4929fecbda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:d6:ff', 'vm-uuid': '027f1645-6991-4726-b1f4-2728db710061'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:27 user nova-compute[82522]: INFO os_vif [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d6:ff,bridge_name='br-int',has_traffic_filtering=True,id=8c280312-1554-4ee3-aadd-aa4929fecbda,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c280312-15')
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No VIF found with MAC fa:16:3e:32:d6:ff, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.network.neutron [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updated VIF entry in instance network info cache for port 8c280312-1554-4ee3-aadd-aa4929fecbda. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG nova.network.neutron [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updating instance_info_cache with network_info: [{"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:10:27 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] Releasing lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:10:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received event network-vif-plugged-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:10:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] Lock "027f1645-6991-4726-b1f4-2728db710061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:28 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] Lock "027f1645-6991-4726-b1f4-2728db710061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:28 user nova-compute[82522]: DEBUG nova.compute.manager [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] No waiting events found dispatching network-vif-plugged-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:10:28 user nova-compute[82522]: WARNING nova.compute.manager [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received unexpected event network-vif-plugged-8c280312-1554-4ee3-aadd-aa4929fecbda for instance with vm_state building and task_state spawning.
Apr 17 11:10:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729830.6284597, 027f1645-6991-4726-b1f4-2728db710061 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:10:30 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] VM Resumed (Lifecycle Event)
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:10:30 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 027f1645-6991-4726-b1f4-2728db710061] Instance spawned successfully.
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:10:30 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729830.6311917, 027f1645-6991-4726-b1f4-2728db710061 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:10:30 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] VM Started (Lifecycle Event)
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:10:30 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:10:30 user nova-compute[82522]: INFO nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Took 5.33 seconds to spawn the instance on the hypervisor.
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:10:30 user nova-compute[82522]: INFO nova.compute.manager [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Took 5.87 seconds to build instance.
Apr 17 11:10:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.966s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received event network-vif-plugged-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] Lock "027f1645-6991-4726-b1f4-2728db710061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] Lock "027f1645-6991-4726-b1f4-2728db710061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:30 user nova-compute[82522]: DEBUG nova.compute.manager [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] No waiting events found dispatching network-vif-plugged-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:10:30 user nova-compute[82522]: WARNING nova.compute.manager [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received unexpected event network-vif-plugged-8c280312-1554-4ee3-aadd-aa4929fecbda for instance with vm_state active and task_state None.
Apr 17 11:10:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:42 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:42 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 11:10:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:10:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:10:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:10:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:10:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:10:45 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:10:45 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:10:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8505MB free_disk=26.25662612915039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:10:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 027f1645-6991-4726-b1f4-2728db710061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:10:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:10:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:48 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:50 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:10:51 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:10:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:10:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:10:51 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:10:51 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updating instance_info_cache with network_info: [{"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:10:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-385a180f-e722-4826-a6e0-47608461e66e" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:10:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:10:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 11:10:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 11:10:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:10:59 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:10:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:04 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:11:06 user nova-compute[82522]: INFO nova.compute.manager [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Terminating instance
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.compute.manager [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-unplugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-unplugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-unplugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:07 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Instance destroyed successfully.
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.objects.instance [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'resources' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1289770639',display_name='tempest-ServerRescueNegativeTestJSON-server-1289770639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1289770639',id=41,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6bMYvwfR2NSZpa2Rl+5bZN+PeHM2NB1gHPlHIxTKr9aoqPNqunUDQK+9/cINh0G+oADlw0LFutBwblzU3KSmGbya/iJCiHB43XjPicDxDHVCt+iJIqTXDooiBKY1VBMQ==',key_name='tempest-keypair-1731392485',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:06:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-af060vtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30c15ce534a649ae8a971b33221e2500',uuid=d3ee5567-1a2d-4db4-8519-ba4308d8d3b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "address": "fa:16:3e:ae:ed:3d", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb97f09f-c7", "ovs_interfaceid": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ed:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb97f09f-c7') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG os_vif [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ed:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb97f09f-c7') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb97f09f-c7, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:11:07 user nova-compute[82522]: INFO os_vif [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ed:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb97f09f-c7')
Apr 17 11:11:07 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Deleting instance files /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6_del
Apr 17 11:11:07 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Deletion of /opt/stack/data/nova/instances/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6_del complete
Apr 17 11:11:07 user nova-compute[82522]: INFO nova.compute.manager [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 17 11:11:07 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:11:07 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:11:08 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:11:08 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Took 0.69 seconds to deallocate network for instance.
Apr 17 11:11:08 user nova-compute[82522]: DEBUG nova.compute.manager [req-d35832bf-e4a4-47ec-b99b-6961b50d784f req-8d8832f8-7484-4a7f-9de4-3546a9a8b280 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-deleted-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:11:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:08 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:11:08 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:11:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:11:08 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Deleted allocations for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6
Apr 17 11:11:08 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:11:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:11:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] Acquiring lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:09 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] Lock "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:11:09 user nova-compute[82522]: DEBUG nova.compute.manager [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] No waiting events found dispatching network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:11:09 user nova-compute[82522]: WARNING nova.compute.manager [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Received unexpected event network-vif-plugged-bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance with vm_state deleted and task_state None.
Apr 17 11:11:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:22 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729867.7486467, d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:11:22 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] VM Stopped (Lifecycle Event)
Apr 17 11:11:22 user nova-compute[82522]: DEBUG nova.compute.manager [None req-3ead5c58-d4e1-4cb0-9b54-20da32ce9a52 None None] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:11:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:11:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:11:44 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:11:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:11:46 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:11:46 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:11:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=26.27554702758789GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 385a180f-e722-4826-a6e0-47608461e66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 027f1645-6991-4726-b1f4-2728db710061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:11:46 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:11:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:48 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:51 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:11:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 11:11:51 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:52 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:52 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:11:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:11:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:11:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:11:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:11:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 027f1645-6991-4726-b1f4-2728db710061 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "385a180f-e722-4826-a6e0-47608461e66e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "027f1645-6991-4726-b1f4-2728db710061" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "385a180f-e722-4826-a6e0-47608461e66e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:11:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "027f1645-6991-4726-b1f4-2728db710061" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "385a180f-e722-4826-a6e0-47608461e66e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:04 user nova-compute[82522]: INFO nova.compute.manager [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Terminating instance
Apr 17 11:12:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:12:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-unplugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] No waiting events found dispatching network-vif-unplugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-unplugged-8fca060e-eb45-4132-9515-99574c15e1a0 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Instance destroyed successfully.
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.objects.instance [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'resources' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1439667505',display_name='tempest-ServerRescueNegativeTestJSON-server-1439667505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1439667505',id=35,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T10:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-kyumsi6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T10:57:56Z,user_data=None,user_id='30c15ce534a649ae8a971b33221e2500',uuid=385a180f-e722-4826-a6e0-47608461e66e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "8fca060e-eb45-4132-9515-99574c15e1a0", "address": "fa:16:3e:b7:de:f3", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fca060e-eb", "ovs_interfaceid": "8fca060e-eb45-4132-9515-99574c15e1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:de:f3,bridge_name='br-int',has_traffic_filtering=True,id=8fca060e-eb45-4132-9515-99574c15e1a0,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fca060e-eb') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG os_vif [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:de:f3,bridge_name='br-int',has_traffic_filtering=True,id=8fca060e-eb45-4132-9515-99574c15e1a0,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fca060e-eb') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fca060e-eb, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:12:05 user nova-compute[82522]: INFO os_vif [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:de:f3,bridge_name='br-int',has_traffic_filtering=True,id=8fca060e-eb45-4132-9515-99574c15e1a0,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fca060e-eb')
Apr 17 11:12:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Deleting instance files /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e_del
Apr 17 11:12:05 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Deletion of /opt/stack/data/nova/instances/385a180f-e722-4826-a6e0-47608461e66e_del complete
Apr 17 11:12:05 user nova-compute[82522]: INFO nova.compute.manager [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 17 11:12:05 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 385a180f-e722-4826-a6e0-47608461e66e] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:12:05 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Took 0.48 seconds to deallocate network for instance.
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.compute.manager [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-deleted-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:05 user nova-compute[82522]: INFO nova.compute.manager [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Neutron deleted interface 8fca060e-eb45-4132-9515-99574c15e1a0; detaching it from the instance and deleting it from the info cache
Apr 17 11:12:05 user nova-compute[82522]: DEBUG nova.network.neutron [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:12:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Detach interface failed, port_id=8fca060e-eb45-4132-9515-99574c15e1a0, reason: Instance 385a180f-e722-4826-a6e0-47608461e66e could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 11:12:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:06 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:12:06 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:12:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:06 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Deleted allocations for instance 385a180f-e722-4826-a6e0-47608461e66e
Apr 17 11:12:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "385a180f-e722-4826-a6e0-47608461e66e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.502s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] Acquiring lock "385a180f-e722-4826-a6e0-47608461e66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:07 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] Lock "385a180f-e722-4826-a6e0-47608461e66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:07 user nova-compute[82522]: DEBUG nova.compute.manager [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] No waiting events found dispatching network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:12:07 user nova-compute[82522]: WARNING nova.compute.manager [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Received unexpected event network-vif-plugged-8fca060e-eb45-4132-9515-99574c15e1a0 for instance with vm_state deleted and task_state None.
Apr 17 11:12:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received event network-changed-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:15 user nova-compute[82522]: DEBUG nova.compute.manager [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Refreshing instance network info cache due to event network-changed-8c280312-1554-4ee3-aadd-aa4929fecbda. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:12:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] Acquiring lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:12:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] Acquired lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:12:15 user nova-compute[82522]: DEBUG nova.network.neutron [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Refreshing network info cache for port 8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:12:16 user nova-compute[82522]: DEBUG nova.network.neutron [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updated VIF entry in instance network info cache for port 8c280312-1554-4ee3-aadd-aa4929fecbda. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:12:16 user nova-compute[82522]: DEBUG nova.network.neutron [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updating instance_info_cache with network_info: [{"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:12:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] Releasing lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'flavor' on Instance uuid 027f1645-6991-4726-b1f4-2728db710061 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:19 user nova-compute[82522]: INFO nova.compute.manager [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Attaching volume e3bcd996-c073-4475-8cd0-b64ef67190b5 to /dev/vdb
Apr 17 11:12:19 user nova-compute[82522]: DEBUG os_brick.utils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c0ce3a-40bc-44fe-b701-145a9be4b29f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af27018-9253-4755-b898-8951d1900f78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b9684-5cea-4d16-b9ca-bc4e46913d49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c0f996-0b59-4a17-b478-1223d6e5cfb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 11:12:19 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:20 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:12:20 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 11:12:20 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d7811-a3a7-4db8-b03c-7b869c496955]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 11:12:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 11:12:20 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 11:12:20 user nova-compute[82522]: DEBUG os_brick.utils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:12:20 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updating existing volume attachment record: 968afa5c-02d6-4160-9720-a898ed48f973 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 11:12:20 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729925.3930905, 385a180f-e722-4826-a6e0-47608461e66e => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:12:20 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 385a180f-e722-4826-a6e0-47608461e66e] VM Stopped (Lifecycle Event)
Apr 17 11:12:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-30c1ea30-83dc-4325-a2ff-91616915a6c5 None None] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXodCJBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:12:24 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:12:24 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:12:24 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[316fe190-9b39-4336-867d-df5247d4bf32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 11:12:24 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6fa06d-fbda-461b-9707-eefefe8e100c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5] added
Apr 17 11:12:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c267d261-64b1-48a4-8d2f-a2f7e8fbe01c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e1491-575a-47a3-bbdc-73b43406a9a1]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXodCJBy {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXodCJBy" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc96cb-a8fc-4f7a-8581-a674a3926d47]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MXodCJBy'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a85d20-41c3-41cb-a8c9-389e6d6dff69]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a71be2-07f4-4111-9663-1feecb5a0ed3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 17 11:12:24 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 17 11:12:24 user nova-compute[82522]:  {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:12:24 user nova-compute[82522]: WARNING os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 17 11:12:24 user nova-compute[82522]: 
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0935a3-868a-4312-900c-351e9f59f0f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5, portal: 172.16.0.220,3260]
Apr 17 11:12:24 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5, portal: 172.16.0.220,3260] successful.
Apr 17 11:12:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e067a394-23ca-40d0-b97c-2333b71951bf]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a058aac4-ef35-451c-8e7d-4a114bd9f38d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 (non-flash)
Apr 17 11:12:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 (non-flash)
Apr 17 11:12:24 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[60002884-3c6f-4230-af77-d6195262bcc0]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXodCJBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 11:12:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:12:25 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26162633562653533', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:12:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162633562653533', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 11:12:25 user nova-compute[82522]: DEBUG nova.objects.instance [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'flavor' on Instance uuid 027f1645-6991-4726-b1f4-2728db710061 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:12:25 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 11:12:25 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:12:25 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 11:12:25 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:12:25 user nova-compute[82522]:   <serial>e3bcd996-c073-4475-8cd0-b64ef67190b5</serial>
Apr 17 11:12:25 user nova-compute[82522]: </disk>
Apr 17 11:12:25 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 11:12:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:12:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:12:26 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No VIF found with MAC fa:16:3e:32:d6:ff, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:12:26 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.520s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:12:30 user nova-compute[82522]: INFO nova.compute.claims [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Claim successful on node user
Apr 17 11:12:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:12:30 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:12:30 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Creating image(s)
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "/opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "/opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG nova.policy [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:30 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk 1073741824" returned: 0 in 0.057s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Cannot resize image /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG nova.objects.instance [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'migration_context' on Instance uuid 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Ensure instance console log exists: /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:31 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Successfully created port: 13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Successfully updated port: 13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "refresh_cache-6c9d8d80-93ff-41f3-85c3-b2175b4532a9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquired lock "refresh_cache-6c9d8d80-93ff-41f3-85c3-b2175b4532a9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-changed-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.compute.manager [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Refreshing instance network info cache due to event network-changed-13f9efc6-6c46-418e-90e7-675a328c3d97. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] Acquiring lock "refresh_cache-6c9d8d80-93ff-41f3-85c3-b2175b4532a9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.network.neutron [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Updating instance_info_cache with network_info: [{"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Releasing lock "refresh_cache-6c9d8d80-93ff-41f3-85c3-b2175b4532a9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Instance network_info: |[{"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] Acquired lock "refresh_cache-6c9d8d80-93ff-41f3-85c3-b2175b4532a9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.network.neutron [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Refreshing network info cache for port 13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Start _get_guest_xml network_info=[{"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:12:32 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:12:32 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-817393154',display_name='tempest-AttachVolumeNegativeTest-server-817393154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-817393154',id=43,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7zxcsT2zwgrpSznzV5iu8363TIIRIzd2drQKgJ5YJXSwVES8tv4HR6SNG7+8lMNGBZruyNkTWf750NIkDBG6APskcc8pEaiiJQgfJsB7q2fZ/NHa1+AO+ecJosZrFlfg==',key_name='tempest-keypair-1860561692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-c709l92l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=6c9d8d80-93ff-41f3-85c3-b2175b4532a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=13f9efc6-6c46-418e-90e7-675a328c3d97,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9efc6-6c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.objects.instance [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:12:32 user nova-compute[82522]:   <uuid>6c9d8d80-93ff-41f3-85c3-b2175b4532a9</uuid>
Apr 17 11:12:32 user nova-compute[82522]:   <name>instance-0000002b</name>
Apr 17 11:12:32 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:12:32 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:12:32 user nova-compute[82522]:   <metadata>
Apr 17 11:12:32 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:12:32 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:12:32 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeNegativeTest-server-817393154</nova:name>
Apr 17 11:12:32 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:12:32</nova:creationTime>
Apr 17 11:12:32 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:12:32 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:12:32 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:12:32 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:12:32 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:12:32 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:12:32 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:12:32 user nova-compute[82522]:       <nova:owner>
Apr 17 11:12:32 user nova-compute[82522]:         <nova:user uuid="8fc272a75798487d84beedfa65775423">tempest-AttachVolumeNegativeTest-60160992-project-member</nova:user>
Apr 17 11:12:32 user nova-compute[82522]:         <nova:project uuid="64eccc3b86914e4ab735b79c4b53a142">tempest-AttachVolumeNegativeTest-60160992</nova:project>
Apr 17 11:12:32 user nova-compute[82522]:       </nova:owner>
Apr 17 11:12:32 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 11:12:32 user nova-compute[82522]:       <nova:ports>
Apr 17 11:12:32 user nova-compute[82522]:         <nova:port uuid="13f9efc6-6c46-418e-90e7-675a328c3d97">
Apr 17 11:12:32 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 17 11:12:32 user nova-compute[82522]:         </nova:port>
Apr 17 11:12:32 user nova-compute[82522]:       </nova:ports>
Apr 17 11:12:32 user nova-compute[82522]:     </nova:instance>
Apr 17 11:12:32 user nova-compute[82522]:   </metadata>
Apr 17 11:12:32 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:12:32 user nova-compute[82522]:     <system>
Apr 17 11:12:32 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:12:32 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:12:32 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:12:32 user nova-compute[82522]:       <entry name="serial">6c9d8d80-93ff-41f3-85c3-b2175b4532a9</entry>
Apr 17 11:12:32 user nova-compute[82522]:       <entry name="uuid">6c9d8d80-93ff-41f3-85c3-b2175b4532a9</entry>
Apr 17 11:12:32 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:12:32 user nova-compute[82522]:     </system>
Apr 17 11:12:32 user nova-compute[82522]:   </sysinfo>
Apr 17 11:12:32 user nova-compute[82522]:   <os>
Apr 17 11:12:32 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:12:32 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:12:32 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:12:32 user nova-compute[82522]:   </os>
Apr 17 11:12:32 user nova-compute[82522]:   <features>
Apr 17 11:12:32 user nova-compute[82522]:     <acpi/>
Apr 17 11:12:32 user nova-compute[82522]:     <apic/>
Apr 17 11:12:32 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:12:32 user nova-compute[82522]:   </features>
Apr 17 11:12:32 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:12:32 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:12:32 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:12:32 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:12:32 user nova-compute[82522]:   </clock>
Apr 17 11:12:32 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:12:32 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:12:32 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:12:32 user nova-compute[82522]:   </cpu>
Apr 17 11:12:32 user nova-compute[82522]:   <devices>
Apr 17 11:12:32 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:12:32 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:12:32 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk"/>
Apr 17 11:12:32 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:12:32 user nova-compute[82522]:     </disk>
Apr 17 11:12:32 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:12:32 user nova-compute[82522]:       <mac address="fa:16:3e:46:35:7d"/>
Apr 17 11:12:32 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:12:32 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:12:32 user nova-compute[82522]:       <target dev="tap13f9efc6-6c"/>
Apr 17 11:12:32 user nova-compute[82522]:     </interface>
Apr 17 11:12:32 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:12:32 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/console.log" append="off"/>
Apr 17 11:12:32 user nova-compute[82522]:     </serial>
Apr 17 11:12:32 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:12:32 user nova-compute[82522]:     <video>
Apr 17 11:12:32 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:12:32 user nova-compute[82522]:     </video>
Apr 17 11:12:32 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:12:32 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:12:32 user nova-compute[82522]:     </rng>
Apr 17 11:12:32 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:12:32 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:12:32 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:12:32 user nova-compute[82522]:     </memballoon>
Apr 17 11:12:32 user nova-compute[82522]:   </devices>
Apr 17 11:12:32 user nova-compute[82522]: </domain>
Apr 17 11:12:32 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-817393154',display_name='tempest-AttachVolumeNegativeTest-server-817393154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-817393154',id=43,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7zxcsT2zwgrpSznzV5iu8363TIIRIzd2drQKgJ5YJXSwVES8tv4HR6SNG7+8lMNGBZruyNkTWf750NIkDBG6APskcc8pEaiiJQgfJsB7q2fZ/NHa1+AO+ecJosZrFlfg==',key_name='tempest-keypair-1860561692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-c709l92l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=6c9d8d80-93ff-41f3-85c3-b2175b4532a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=13f9efc6-6c46-418e-90e7-675a328c3d97,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9efc6-6c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG os_vif [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=13f9efc6-6c46-418e-90e7-675a328c3d97,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9efc6-6c') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13f9efc6-6c, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13f9efc6-6c, col_values=(('external_ids', {'iface-id': '13f9efc6-6c46-418e-90e7-675a328c3d97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:35:7d', 'vm-uuid': '6c9d8d80-93ff-41f3-85c3-b2175b4532a9'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:32 user nova-compute[82522]: INFO os_vif [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=13f9efc6-6c46-418e-90e7-675a328c3d97,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9efc6-6c')
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:12:32 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No VIF found with MAC fa:16:3e:46:35:7d, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:12:33 user nova-compute[82522]: DEBUG nova.network.neutron [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Updated VIF entry in instance network info cache for port 13f9efc6-6c46-418e-90e7-675a328c3d97. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:12:33 user nova-compute[82522]: DEBUG nova.network.neutron [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Updating instance_info_cache with network_info: [{"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:12:33 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] Releasing lock "refresh_cache-6c9d8d80-93ff-41f3-85c3-b2175b4532a9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:12:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:34 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:34 user nova-compute[82522]: DEBUG nova.compute.manager [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] No waiting events found dispatching network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:12:34 user nova-compute[82522]: WARNING nova.compute.manager [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received unexpected event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 for instance with vm_state building and task_state spawning.
Apr 17 11:12:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729956.1270978, 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:12:36 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] VM Resumed (Lifecycle Event)
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:12:36 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Instance spawned successfully.
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:12:36 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681729956.130443, 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:12:36 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] VM Started (Lifecycle Event)
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:12:36 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:12:36 user nova-compute[82522]: INFO nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Took 5.51 seconds to spawn the instance on the hypervisor.
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] No waiting events found dispatching network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:12:36 user nova-compute[82522]: WARNING nova.compute.manager [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received unexpected event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 for instance with vm_state building and task_state spawning.
Apr 17 11:12:36 user nova-compute[82522]: INFO nova.compute.manager [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Took 6.05 seconds to build instance.
Apr 17 11:12:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.147s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:45 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:12:48 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:12:48 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:12:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8599MB free_disk=26.31170654296875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 027f1645-6991-4726-b1f4-2728db710061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:12:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:12:49 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:12:49 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:12:49 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:12:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [{"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:12:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:55 user nova-compute[82522]: INFO nova.compute.manager [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Terminating instance
Apr 17 11:12:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-unplugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-unplugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:12:55 user nova-compute[82522]: DEBUG nova.compute.manager [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-unplugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:12:56 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Instance destroyed successfully.
Apr 17 11:12:56 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'resources' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T10:55:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1021874936',display_name='tempest-ServerRescueNegativeTestJSON-server-1021874936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1021874936',id=34,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3747b7d3c6844772b0e6eed5299053ba',ramdisk_id='',reservation_id='r-w9lehq7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1988041396',owner_user_name='tempest-ServerRescueNegativeTestJSON-1988041396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:02:40Z,user_data=None,user_id='30c15ce534a649ae8a971b33221e2500',uuid=06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converting VIF {"id": "9c6c71a5-0190-4112-9044-5c238344dc88", "address": "fa:16:3e:07:47:fb", "network": {"id": "f7747405-4e8a-4372-b07e-5ebf2852fe5f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-22423093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747b7d3c6844772b0e6eed5299053ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6c71a5-01", "ovs_interfaceid": "9c6c71a5-0190-4112-9044-5c238344dc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:47:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c6c71a5-0190-4112-9044-5c238344dc88,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6c71a5-01') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG os_vif [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:47:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c6c71a5-0190-4112-9044-5c238344dc88,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6c71a5-01') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c6c71a5-01, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:12:56 user nova-compute[82522]: INFO os_vif [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:47:fb,bridge_name='br-int',has_traffic_filtering=True,id=9c6c71a5-0190-4112-9044-5c238344dc88,network=Network(f7747405-4e8a-4372-b07e-5ebf2852fe5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6c71a5-01')
Apr 17 11:12:56 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Deleting instance files /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f_del
Apr 17 11:12:56 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Deletion of /opt/stack/data/nova/instances/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f_del complete
Apr 17 11:12:56 user nova-compute[82522]: INFO nova.compute.manager [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 17 11:12:56 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:12:56 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Took 0.61 seconds to deallocate network for instance.
Apr 17 11:12:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-b5c509af-914b-4187-929e-dbef24c58920 req-504a26a8-0a1a-4a05-8a0e-be0c02f4a86e service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-deleted-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:12:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:12:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:57 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Deleted allocations for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f
Apr 17 11:12:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.764s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:57 user nova-compute[82522]: DEBUG nova.compute.manager [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:12:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] Acquiring lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:12:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:12:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] Lock "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:12:57 user nova-compute[82522]: DEBUG nova.compute.manager [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] No waiting events found dispatching network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:12:57 user nova-compute[82522]: WARNING nova.compute.manager [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Received unexpected event network-vif-plugged-9c6c71a5-0190-4112-9044-5c238344dc88 for instance with vm_state deleted and task_state None.
Apr 17 11:13:00 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:06 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:11 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681729976.1804838, 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:13:11 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] VM Stopped (Lifecycle Event)
Apr 17 11:13:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4fe28d78-49f2-44fb-a64d-aba0200955c9 None None] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:13:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:13:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:13:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:13:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:13:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:26 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:13:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:13:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:13:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:13:31 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:36 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:13:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:46 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:13:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:48 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:13:48 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:13:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=26.30333709716797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 027f1645-6991-4726-b1f4-2728db710061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:13:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:13:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:53 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:13:54 user nova-compute[82522]: INFO nova.compute.claims [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Claim successful on node user
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updating instance_info_cache with network_info: [{"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:13:54 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.policy [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c994df66781047cd9fd114711b94606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a166c75d3243199b27bfc1fe838615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:13:54 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Creating image(s)
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "/opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "/opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:13:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.143s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.130s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk 1073741824" returned: 0 in 0.052s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Successfully created port: 1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Cannot resize image /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lazy-loading 'migration_context' on Instance uuid 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Ensure instance console log exists: /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:13:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Successfully updated port: 1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "refresh_cache-3fed4f97-8392-4f60-a0b5-c74f5100dbc4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquired lock "refresh_cache-3fed4f97-8392-4f60-a0b5-c74f5100dbc4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received event network-changed-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.compute.manager [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Refreshing instance network info cache due to event network-changed-1e507e18-60cc-4d35-af55-72a252172e88. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] Acquiring lock "refresh_cache-3fed4f97-8392-4f60-a0b5-c74f5100dbc4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Updating instance_info_cache with network_info: [{"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Releasing lock "refresh_cache-3fed4f97-8392-4f60-a0b5-c74f5100dbc4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Instance network_info: |[{"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] Acquired lock "refresh_cache-3fed4f97-8392-4f60-a0b5-c74f5100dbc4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.network.neutron [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Refreshing network info cache for port 1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Start _get_guest_xml network_info=[{"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:13:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:13:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1694998313',display_name='tempest-VolumesActionsTest-instance-1694998313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1694998313',id=44,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44a166c75d3243199b27bfc1fe838615',ramdisk_id='',reservation_id='r-hcuw6opc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-581321534',owner_user_name='tempest-VolumesActionsTest-581321534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:13:55Z,user_data=None,user_id='c994df66781047cd9fd114711b94606e',uuid=3fed4f97-8392-4f60-a0b5-c74f5100dbc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Converting VIF {"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e507e18-60cc-4d35-af55-72a252172e88,network=Network(d9ffbb87-02a7-471a-befa-bd62b79a816d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e507e18-60') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:13:56 user nova-compute[82522]:   <uuid>3fed4f97-8392-4f60-a0b5-c74f5100dbc4</uuid>
Apr 17 11:13:56 user nova-compute[82522]:   <name>instance-0000002c</name>
Apr 17 11:13:56 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:13:56 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:13:56 user nova-compute[82522]:   <metadata>
Apr 17 11:13:56 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:13:56 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:13:56 user nova-compute[82522]:       <nova:name>tempest-VolumesActionsTest-instance-1694998313</nova:name>
Apr 17 11:13:56 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:13:56</nova:creationTime>
Apr 17 11:13:56 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:13:56 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:13:56 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:13:56 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:13:56 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:13:56 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:13:56 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:13:56 user nova-compute[82522]:       <nova:owner>
Apr 17 11:13:56 user nova-compute[82522]:         <nova:user uuid="c994df66781047cd9fd114711b94606e">tempest-VolumesActionsTest-581321534-project-member</nova:user>
Apr 17 11:13:56 user nova-compute[82522]:         <nova:project uuid="44a166c75d3243199b27bfc1fe838615">tempest-VolumesActionsTest-581321534</nova:project>
Apr 17 11:13:56 user nova-compute[82522]:       </nova:owner>
Apr 17 11:13:56 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 11:13:56 user nova-compute[82522]:       <nova:ports>
Apr 17 11:13:56 user nova-compute[82522]:         <nova:port uuid="1e507e18-60cc-4d35-af55-72a252172e88">
Apr 17 11:13:56 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 11:13:56 user nova-compute[82522]:         </nova:port>
Apr 17 11:13:56 user nova-compute[82522]:       </nova:ports>
Apr 17 11:13:56 user nova-compute[82522]:     </nova:instance>
Apr 17 11:13:56 user nova-compute[82522]:   </metadata>
Apr 17 11:13:56 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:13:56 user nova-compute[82522]:     <system>
Apr 17 11:13:56 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:13:56 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:13:56 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:13:56 user nova-compute[82522]:       <entry name="serial">3fed4f97-8392-4f60-a0b5-c74f5100dbc4</entry>
Apr 17 11:13:56 user nova-compute[82522]:       <entry name="uuid">3fed4f97-8392-4f60-a0b5-c74f5100dbc4</entry>
Apr 17 11:13:56 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:13:56 user nova-compute[82522]:     </system>
Apr 17 11:13:56 user nova-compute[82522]:   </sysinfo>
Apr 17 11:13:56 user nova-compute[82522]:   <os>
Apr 17 11:13:56 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:13:56 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:13:56 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:13:56 user nova-compute[82522]:   </os>
Apr 17 11:13:56 user nova-compute[82522]:   <features>
Apr 17 11:13:56 user nova-compute[82522]:     <acpi/>
Apr 17 11:13:56 user nova-compute[82522]:     <apic/>
Apr 17 11:13:56 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:13:56 user nova-compute[82522]:   </features>
Apr 17 11:13:56 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:13:56 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:13:56 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:13:56 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:13:56 user nova-compute[82522]:   </clock>
Apr 17 11:13:56 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:13:56 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:13:56 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:13:56 user nova-compute[82522]:   </cpu>
Apr 17 11:13:56 user nova-compute[82522]:   <devices>
Apr 17 11:13:56 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:13:56 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:13:56 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk"/>
Apr 17 11:13:56 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:13:56 user nova-compute[82522]:     </disk>
Apr 17 11:13:56 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:13:56 user nova-compute[82522]:       <mac address="fa:16:3e:e0:5a:4b"/>
Apr 17 11:13:56 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:13:56 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:13:56 user nova-compute[82522]:       <target dev="tap1e507e18-60"/>
Apr 17 11:13:56 user nova-compute[82522]:     </interface>
Apr 17 11:13:56 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:13:56 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/console.log" append="off"/>
Apr 17 11:13:56 user nova-compute[82522]:     </serial>
Apr 17 11:13:56 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:13:56 user nova-compute[82522]:     <video>
Apr 17 11:13:56 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:13:56 user nova-compute[82522]:     </video>
Apr 17 11:13:56 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:13:56 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:13:56 user nova-compute[82522]:     </rng>
Apr 17 11:13:56 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:13:56 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:13:56 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:13:56 user nova-compute[82522]:     </memballoon>
Apr 17 11:13:56 user nova-compute[82522]:   </devices>
Apr 17 11:13:56 user nova-compute[82522]: </domain>
Apr 17 11:13:56 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1694998313',display_name='tempest-VolumesActionsTest-instance-1694998313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1694998313',id=44,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44a166c75d3243199b27bfc1fe838615',ramdisk_id='',reservation_id='r-hcuw6opc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-581321534',owner_user_name='tempest-VolumesActionsTest-581321534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:13:55Z,user_data=None,user_id='c994df66781047cd9fd114711b94606e',uuid=3fed4f97-8392-4f60-a0b5-c74f5100dbc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Converting VIF {"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e507e18-60cc-4d35-af55-72a252172e88,network=Network(d9ffbb87-02a7-471a-befa-bd62b79a816d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e507e18-60') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG os_vif [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e507e18-60cc-4d35-af55-72a252172e88,network=Network(d9ffbb87-02a7-471a-befa-bd62b79a816d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e507e18-60') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e507e18-60, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e507e18-60, col_values=(('external_ids', {'iface-id': '1e507e18-60cc-4d35-af55-72a252172e88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:5a:4b', 'vm-uuid': '3fed4f97-8392-4f60-a0b5-c74f5100dbc4'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:56 user nova-compute[82522]: INFO os_vif [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e507e18-60cc-4d35-af55-72a252172e88,network=Network(d9ffbb87-02a7-471a-befa-bd62b79a816d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e507e18-60')
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:13:56 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] No VIF found with MAC fa:16:3e:e0:5a:4b, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:13:57 user nova-compute[82522]: DEBUG nova.network.neutron [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Updated VIF entry in instance network info cache for port 1e507e18-60cc-4d35-af55-72a252172e88. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:13:57 user nova-compute[82522]: DEBUG nova.network.neutron [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Updating instance_info_cache with network_info: [{"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:13:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] Releasing lock "refresh_cache-3fed4f97-8392-4f60-a0b5-c74f5100dbc4" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:13:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:13:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received event network-vif-plugged-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:13:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] Acquiring lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:13:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:13:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:13:58 user nova-compute[82522]: DEBUG nova.compute.manager [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] No waiting events found dispatching network-vif-plugged-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:13:58 user nova-compute[82522]: WARNING nova.compute.manager [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received unexpected event network-vif-plugged-1e507e18-60cc-4d35-af55-72a252172e88 for instance with vm_state building and task_state spawning.
Apr 17 11:13:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681730040.3450112, 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:14:00 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] VM Resumed (Lifecycle Event)
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:14:00 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Instance spawned successfully.
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:14:00 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681730040.3468652, 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:14:00 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] VM Started (Lifecycle Event)
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:14:00 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received event network-vif-plugged-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] Acquiring lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.compute.manager [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] No waiting events found dispatching network-vif-plugged-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:14:00 user nova-compute[82522]: WARNING nova.compute.manager [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received unexpected event network-vif-plugged-1e507e18-60cc-4d35-af55-72a252172e88 for instance with vm_state building and task_state spawning.
Apr 17 11:14:00 user nova-compute[82522]: INFO nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 17 11:14:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:14:00 user nova-compute[82522]: INFO nova.compute.manager [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Took 6.14 seconds to build instance.
Apr 17 11:14:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.247s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:01 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:14:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:06 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:14:11 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:14:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-changed-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Refreshing instance network info cache due to event network-changed-13f9efc6-6c46-418e-90e7-675a328c3d97. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] Acquiring lock "refresh_cache-6c9d8d80-93ff-41f3-85c3-b2175b4532a9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] Acquired lock "refresh_cache-6c9d8d80-93ff-41f3-85c3-b2175b4532a9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG nova.network.neutron [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Refreshing network info cache for port 13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:21 user nova-compute[82522]: INFO nova.compute.manager [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Terminating instance
Apr 17 11:14:21 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG nova.network.neutron [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Updated VIF entry in instance network info cache for port 13f9efc6-6c46-418e-90e7-675a328c3d97. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG nova.network.neutron [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Updating instance_info_cache with network_info: [{"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] Releasing lock "refresh_cache-6c9d8d80-93ff-41f3-85c3-b2175b4532a9" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-vif-unplugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] No waiting events found dispatching network-vif-unplugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG nova.compute.manager [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-vif-unplugged-13f9efc6-6c46-418e-90e7-675a328c3d97 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:14:21 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Instance destroyed successfully.
Apr 17 11:14:22 user nova-compute[82522]: DEBUG nova.objects.instance [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'resources' on Instance uuid 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-817393154',display_name='tempest-AttachVolumeNegativeTest-server-817393154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-817393154',id=43,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7zxcsT2zwgrpSznzV5iu8363TIIRIzd2drQKgJ5YJXSwVES8tv4HR6SNG7+8lMNGBZruyNkTWf750NIkDBG6APskcc8pEaiiJQgfJsB7q2fZ/NHa1+AO+ecJosZrFlfg==',key_name='tempest-keypair-1860561692',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:12:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-c709l92l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=6c9d8d80-93ff-41f3-85c3-b2175b4532a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "13f9efc6-6c46-418e-90e7-675a328c3d97", "address": "fa:16:3e:46:35:7d", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9efc6-6c", "ovs_interfaceid": "13f9efc6-6c46-418e-90e7-675a328c3d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=13f9efc6-6c46-418e-90e7-675a328c3d97,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9efc6-6c') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG os_vif [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=13f9efc6-6c46-418e-90e7-675a328c3d97,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9efc6-6c') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13f9efc6-6c, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:14:22 user nova-compute[82522]: INFO os_vif [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=13f9efc6-6c46-418e-90e7-675a328c3d97,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9efc6-6c')
Apr 17 11:14:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Deleting instance files /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9_del
Apr 17 11:14:22 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Deletion of /opt/stack/data/nova/instances/6c9d8d80-93ff-41f3-85c3-b2175b4532a9_del complete
Apr 17 11:14:22 user nova-compute[82522]: INFO nova.compute.manager [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 17 11:14:22 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:22 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:14:23 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Took 0.81 seconds to deallocate network for instance.
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:23 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Deleted allocations for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-8d063cec-0eb5-49a5-b9dc-f6c76e5e4394 req-8af32cf7-d4cd-4c71-b3a2-9d6a11ae598a service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-vif-deleted-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.808s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] No waiting events found dispatching network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:14:23 user nova-compute[82522]: WARNING nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received unexpected event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 for instance with vm_state deleted and task_state None.
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] No waiting events found dispatching network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:14:23 user nova-compute[82522]: WARNING nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received unexpected event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 for instance with vm_state deleted and task_state None.
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] No waiting events found dispatching network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:14:23 user nova-compute[82522]: WARNING nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received unexpected event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 for instance with vm_state deleted and task_state None.
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Acquiring lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "6c9d8d80-93ff-41f3-85c3-b2175b4532a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:23 user nova-compute[82522]: DEBUG nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] No waiting events found dispatching network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:14:23 user nova-compute[82522]: WARNING nova.compute.manager [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Received unexpected event network-vif-plugged-13f9efc6-6c46-418e-90e7-675a328c3d97 for instance with vm_state deleted and task_state None.
Apr 17 11:14:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:37 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681730062.0886602, 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:14:37 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] VM Stopped (Lifecycle Event)
Apr 17 11:14:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f3e88b57-15a7-4b93-bf4b-a87ca1032b5a None None] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:14:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:14:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:14:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:14:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:14:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:14:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82522) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:14:49 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:14:50 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:14:50 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:14:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=26.302284240722656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 027f1645-6991-4726-b1f4-2728db710061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:14:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:14:51 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:14:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:14:53 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:14:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:14:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:14:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 11:14:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:14:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:14:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:14:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:14:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:14:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:14:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:14:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:14:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:01 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:15:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:15:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:15:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:15:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:15:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:15:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:15:12 user nova-compute[82522]: INFO nova.compute.manager [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Detaching volume e3bcd996-c073-4475-8cd0-b64ef67190b5
Apr 17 11:15:12 user nova-compute[82522]: INFO nova.virt.block_device [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Attempting to driver detach volume e3bcd996-c073-4475-8cd0-b64ef67190b5 from mountpoint /dev/vdb
Apr 17 11:15:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Attempting to detach device vdb from instance 027f1645-6991-4726-b1f4-2728db710061 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 11:15:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 11:15:12 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:15:12 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 11:15:12 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:15:12 user nova-compute[82522]:   <serial>e3bcd996-c073-4475-8cd0-b64ef67190b5</serial>
Apr 17 11:15:12 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 11:15:12 user nova-compute[82522]: </disk>
Apr 17 11:15:12 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 11:15:12 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully detached device vdb from instance 027f1645-6991-4726-b1f4-2728db710061 from the persistent domain config.
Apr 17 11:15:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 027f1645-6991-4726-b1f4-2728db710061 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 11:15:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 11:15:12 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:15:12 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 11:15:12 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:15:12 user nova-compute[82522]:   <serial>e3bcd996-c073-4475-8cd0-b64ef67190b5</serial>
Apr 17 11:15:12 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 11:15:12 user nova-compute[82522]: </disk>
Apr 17 11:15:12 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681730113.417602, 027f1645-6991-4726-b1f4-2728db710061 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 027f1645-6991-4726-b1f4-2728db710061 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 11:15:13 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully detached device vdb from instance 027f1645-6991-4726-b1f4-2728db710061 from the live domain config.
Apr 17 11:15:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXodCJBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:15:13 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc98bcd3-1b15-4bfe-9b3a-a111d40f4a0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 11:15:13 user nova-compute[82522]: No targets found.
Apr 17 11:15:13 user nova-compute[82522]: iSNS:
Apr 17 11:15:13 user nova-compute[82522]: No targets found.
Apr 17 11:15:13 user nova-compute[82522]: STATIC:
Apr 17 11:15:13 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5
Apr 17 11:15:13 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:15:13 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:15:13 user nova-compute[82522]: FIRMWARE:
Apr 17 11:15:13 user nova-compute[82522]: No targets found.
Apr 17 11:15:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 11:15:13 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 11:15:13 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2776dd-0a13-42f3-b058-7dc1ca81903c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbf85b2-2f6b-4d28-a04c-8749276b4cf5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 (non-flash)
Apr 17 11:15:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 (non-flash)
Apr 17 11:15:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2b7de5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73fd8c1-58b6-4804-bc91-ec9c4f3027df]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbf3794-fbb3-421a-8dfb-33231633d3d2]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebcd5dc-1eb9-4b32-9136-6f2bf95a478e]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3039ae1a-10db-47b7-9e34-23c9b1e28099]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22d2713-07f4-40f6-8215-661aa330ce69]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[412aea9a-19e0-4dc7-b7a1-f189e1da5673]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5, portal: 172.16.0.220,3260]
Apr 17 11:15:13 user nova-compute[82522]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5, portal: 172.16.0.220,3260] successful.
Apr 17 11:15:13 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bcd996-c073-4475-8cd0-b64ef67190b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b30c2d-620f-40bc-a450-740294f474d4]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] <== disconnect_volume: return (294ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:15:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 11:15:14 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'flavor' on Instance uuid 027f1645-6991-4726-b1f4-2728db710061 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:15:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.645s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:15:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:15:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:15:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:15:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:15:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:15:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:15:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:15:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:15:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:15:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:43 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 11:15:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:15:50 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:15:51 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:15:51 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=26.30133056640625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:15:51 user nova-compute[82522]: INFO nova.compute.manager [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Terminating instance
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 027f1645-6991-4726-b1f4-2728db710061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received event network-vif-unplugged-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] Acquiring lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] No waiting events found dispatching network-vif-unplugged-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received event network-vif-unplugged-1e507e18-60cc-4d35-af55-72a252172e88 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:15:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Instance destroyed successfully.
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.objects.instance [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lazy-loading 'resources' on Instance uuid 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1694998313',display_name='tempest-VolumesActionsTest-instance-1694998313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1694998313',id=44,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:14:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44a166c75d3243199b27bfc1fe838615',ramdisk_id='',reservation_id='r-hcuw6opc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-581321534',owner_user_name='tempest-VolumesActionsTest-581321534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:14:01Z,user_data=None,user_id='c994df66781047cd9fd114711b94606e',uuid=3fed4f97-8392-4f60-a0b5-c74f5100dbc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Converting VIF {"id": "1e507e18-60cc-4d35-af55-72a252172e88", "address": "fa:16:3e:e0:5a:4b", "network": {"id": "d9ffbb87-02a7-471a-befa-bd62b79a816d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-779868504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44a166c75d3243199b27bfc1fe838615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e507e18-60", "ovs_interfaceid": "1e507e18-60cc-4d35-af55-72a252172e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e507e18-60cc-4d35-af55-72a252172e88,network=Network(d9ffbb87-02a7-471a-befa-bd62b79a816d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e507e18-60') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG os_vif [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e507e18-60cc-4d35-af55-72a252172e88,network=Network(d9ffbb87-02a7-471a-befa-bd62b79a816d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e507e18-60') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e507e18-60, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:15:51 user nova-compute[82522]: INFO os_vif [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e507e18-60cc-4d35-af55-72a252172e88,network=Network(d9ffbb87-02a7-471a-befa-bd62b79a816d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e507e18-60')
Apr 17 11:15:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Deleting instance files /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4_del
Apr 17 11:15:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Deletion of /opt/stack/data/nova/instances/3fed4f97-8392-4f60-a0b5-c74f5100dbc4_del complete
Apr 17 11:15:52 user nova-compute[82522]: INFO nova.compute.manager [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 17 11:15:52 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:15:52 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:15:52 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:15:52 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:15:52 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Took 0.43 seconds to deallocate network for instance.
Apr 17 11:15:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:15:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:15:52 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:15:52 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:15:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:15:52 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Deleted allocations for instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4
Apr 17 11:15:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.398s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:15:53 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:53 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received event network-vif-plugged-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:15:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] Acquiring lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:15:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:15:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] Lock "3fed4f97-8392-4f60-a0b5-c74f5100dbc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:15:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] No waiting events found dispatching network-vif-plugged-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:15:53 user nova-compute[82522]: WARNING nova.compute.manager [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received unexpected event network-vif-plugged-1e507e18-60cc-4d35-af55-72a252172e88 for instance with vm_state deleted and task_state None.
Apr 17 11:15:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Received event network-vif-deleted-1e507e18-60cc-4d35-af55-72a252172e88 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 027f1645-6991-4726-b1f4-2728db710061 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updating instance_info_cache with network_info: [{"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-027f1645-6991-4726-b1f4-2728db710061" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:15:54 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:15:55 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:15:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 11:15:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 11:15:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:58 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:15:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:16:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:16:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:16:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:16:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:03 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:16:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:03 user nova-compute[82522]: INFO nova.compute.manager [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Terminating instance
Apr 17 11:16:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:16:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received event network-vif-unplugged-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] Lock "027f1645-6991-4726-b1f4-2728db710061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] Lock "027f1645-6991-4726-b1f4-2728db710061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] No waiting events found dispatching network-vif-unplugged-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received event network-vif-unplugged-8c280312-1554-4ee3-aadd-aa4929fecbda for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:16:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 027f1645-6991-4726-b1f4-2728db710061] Instance destroyed successfully.
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.objects.instance [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'resources' on Instance uuid 027f1645-6991-4726-b1f4-2728db710061 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1924403157',display_name='tempest-AttachVolumeNegativeTest-server-1924403157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1924403157',id=42,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ04c7v86JHMXBmJMTmyNeA0qqN/cuBpmzV6m2UWiAkn3llbc6tHPrkAHzr1XTDzkYeypgUcGkGVFUIPNX7q3NKjpvG9aPeS89G8eGq6TwkmjxrkSFdaRb8QjNiIPT6IDg==',key_name='tempest-keypair-1469598392',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:10:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-j0jeatie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=027f1645-6991-4726-b1f4-2728db710061,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "8c280312-1554-4ee3-aadd-aa4929fecbda", "address": "fa:16:3e:32:d6:ff", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c280312-15", "ovs_interfaceid": "8c280312-1554-4ee3-aadd-aa4929fecbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:d6:ff,bridge_name='br-int',has_traffic_filtering=True,id=8c280312-1554-4ee3-aadd-aa4929fecbda,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c280312-15') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG os_vif [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d6:ff,bridge_name='br-int',has_traffic_filtering=True,id=8c280312-1554-4ee3-aadd-aa4929fecbda,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c280312-15') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c280312-15, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:04 user nova-compute[82522]: INFO os_vif [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d6:ff,bridge_name='br-int',has_traffic_filtering=True,id=8c280312-1554-4ee3-aadd-aa4929fecbda,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c280312-15')
Apr 17 11:16:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Deleting instance files /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061_del
Apr 17 11:16:04 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Deletion of /opt/stack/data/nova/instances/027f1645-6991-4726-b1f4-2728db710061_del complete
Apr 17 11:16:04 user nova-compute[82522]: INFO nova.compute.manager [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Took 0.81 seconds to destroy the instance on the hypervisor.
Apr 17 11:16:04 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 027f1645-6991-4726-b1f4-2728db710061] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 027f1645-6991-4726-b1f4-2728db710061] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:16:04 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 027f1645-6991-4726-b1f4-2728db710061] Took 0.65 seconds to deallocate network for instance.
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received event network-vif-deleted-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:16:04 user nova-compute[82522]: INFO nova.compute.manager [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Neutron deleted interface 8c280312-1554-4ee3-aadd-aa4929fecbda; detaching it from the instance and deleting it from the info cache
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.network.neutron [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Detach interface failed, port_id=8c280312-1554-4ee3-aadd-aa4929fecbda, reason: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. {{(pid=82522) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:16:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:04 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Deleted allocations for instance 027f1645-6991-4726-b1f4-2728db710061
Apr 17 11:16:05 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "027f1645-6991-4726-b1f4-2728db710061" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.748s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received event network-vif-plugged-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:16:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] Acquiring lock "027f1645-6991-4726-b1f4-2728db710061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] Lock "027f1645-6991-4726-b1f4-2728db710061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:06 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] Lock "027f1645-6991-4726-b1f4-2728db710061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:06 user nova-compute[82522]: DEBUG nova.compute.manager [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] No waiting events found dispatching network-vif-plugged-8c280312-1554-4ee3-aadd-aa4929fecbda {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:16:06 user nova-compute[82522]: WARNING nova.compute.manager [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] [instance: 027f1645-6991-4726-b1f4-2728db710061] Received unexpected event network-vif-plugged-8c280312-1554-4ee3-aadd-aa4929fecbda for instance with vm_state deleted and task_state None.
Apr 17 11:16:06 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681730151.9484117, 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:16:06 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] VM Stopped (Lifecycle Event)
Apr 17 11:16:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-56268029-448d-4e3d-ab85-b3da74c364b1 None None] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:16:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:19 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681730164.0113704, 027f1645-6991-4726-b1f4-2728db710061 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:16:19 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 027f1645-6991-4726-b1f4-2728db710061] VM Stopped (Lifecycle Event)
Apr 17 11:16:19 user nova-compute[82522]: DEBUG nova.compute.manager [None req-15a1c7f3-054d-49b1-9e53-92142dee77a7 None None] [instance: 027f1645-6991-4726-b1f4-2728db710061] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:16:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:16:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:16:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:16:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:16:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:16:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:16:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:16:50 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:16:50 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=26.338443756103516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:16:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:51 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:16:53 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:16:53 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:16:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:16:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:16:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:16:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:16:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 11:16:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:16:57 user nova-compute[82522]: INFO nova.compute.claims [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Claim successful on node user
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.network.neutron [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:16:57 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.policy [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:16:57 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Creating image(s)
Apr 17 11:16:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "/opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "/opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "/opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk 1073741824" returned: 0 in 0.050s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Cannot resize image /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG nova.objects.instance [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'migration_context' on Instance uuid 4368205b-a69c-49cd-958f-8f193856466a {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Ensure instance console log exists: /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:16:58 user nova-compute[82522]: DEBUG nova.network.neutron [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Successfully created port: 0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.network.neutron [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Successfully updated port: 0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquired lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.network.neutron [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.compute.manager [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received event network-changed-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.compute.manager [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Refreshing instance network info cache due to event network-changed-0b6550cf-9e2a-4181-90de-34925655d07c. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] Acquiring lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.network.neutron [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.network.neutron [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updating instance_info_cache with network_info: [{"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Releasing lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Instance network_info: |[{"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] Acquired lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.network.neutron [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Refreshing network info cache for port 0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Start _get_guest_xml network_info=[{"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:16:59 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:16:59 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-637753123',display_name='tempest-AttachVolumeNegativeTest-server-637753123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-637753123',id=45,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ4Ype3k6uIacOsZ33NhrfeIFHdyZIcZRaN0TXlDymXjIc8Dyf+mNPp09SUT3LS5aaOANPy6I0+2lJinYLQeC+jLmCKVpbkSlM1FGVIZC4ogZOM96rNuSPFeoOJZWp3Ug==',key_name='tempest-keypair-1991316860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-7s3emgka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=4368205b-a69c-49cd-958f-8f193856466a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:51:4e,bridge_name='br-int',has_traffic_filtering=True,id=0b6550cf-9e2a-4181-90de-34925655d07c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b6550cf-9e') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.objects.instance [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'pci_devices' on Instance uuid 4368205b-a69c-49cd-958f-8f193856466a {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:16:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:16:59 user nova-compute[82522]:   <uuid>4368205b-a69c-49cd-958f-8f193856466a</uuid>
Apr 17 11:16:59 user nova-compute[82522]:   <name>instance-0000002d</name>
Apr 17 11:16:59 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:16:59 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:16:59 user nova-compute[82522]:   <metadata>
Apr 17 11:16:59 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:16:59 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:16:59 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeNegativeTest-server-637753123</nova:name>
Apr 17 11:16:59 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:16:59</nova:creationTime>
Apr 17 11:16:59 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:16:59 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:16:59 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:16:59 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:16:59 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:16:59 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:16:59 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:16:59 user nova-compute[82522]:       <nova:owner>
Apr 17 11:16:59 user nova-compute[82522]:         <nova:user uuid="8fc272a75798487d84beedfa65775423">tempest-AttachVolumeNegativeTest-60160992-project-member</nova:user>
Apr 17 11:16:59 user nova-compute[82522]:         <nova:project uuid="64eccc3b86914e4ab735b79c4b53a142">tempest-AttachVolumeNegativeTest-60160992</nova:project>
Apr 17 11:16:59 user nova-compute[82522]:       </nova:owner>
Apr 17 11:16:59 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 11:16:59 user nova-compute[82522]:       <nova:ports>
Apr 17 11:16:59 user nova-compute[82522]:         <nova:port uuid="0b6550cf-9e2a-4181-90de-34925655d07c">
Apr 17 11:16:59 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 11:16:59 user nova-compute[82522]:         </nova:port>
Apr 17 11:16:59 user nova-compute[82522]:       </nova:ports>
Apr 17 11:16:59 user nova-compute[82522]:     </nova:instance>
Apr 17 11:16:59 user nova-compute[82522]:   </metadata>
Apr 17 11:16:59 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:16:59 user nova-compute[82522]:     <system>
Apr 17 11:16:59 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:16:59 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:16:59 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:16:59 user nova-compute[82522]:       <entry name="serial">4368205b-a69c-49cd-958f-8f193856466a</entry>
Apr 17 11:16:59 user nova-compute[82522]:       <entry name="uuid">4368205b-a69c-49cd-958f-8f193856466a</entry>
Apr 17 11:16:59 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:16:59 user nova-compute[82522]:     </system>
Apr 17 11:16:59 user nova-compute[82522]:   </sysinfo>
Apr 17 11:16:59 user nova-compute[82522]:   <os>
Apr 17 11:16:59 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:16:59 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:16:59 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:16:59 user nova-compute[82522]:   </os>
Apr 17 11:16:59 user nova-compute[82522]:   <features>
Apr 17 11:16:59 user nova-compute[82522]:     <acpi/>
Apr 17 11:16:59 user nova-compute[82522]:     <apic/>
Apr 17 11:16:59 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:16:59 user nova-compute[82522]:   </features>
Apr 17 11:16:59 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:16:59 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:16:59 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:16:59 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:16:59 user nova-compute[82522]:   </clock>
Apr 17 11:16:59 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:16:59 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:16:59 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:16:59 user nova-compute[82522]:   </cpu>
Apr 17 11:16:59 user nova-compute[82522]:   <devices>
Apr 17 11:16:59 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:16:59 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:16:59 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk"/>
Apr 17 11:16:59 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:16:59 user nova-compute[82522]:     </disk>
Apr 17 11:16:59 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:16:59 user nova-compute[82522]:       <mac address="fa:16:3e:8c:51:4e"/>
Apr 17 11:16:59 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:16:59 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:16:59 user nova-compute[82522]:       <target dev="tap0b6550cf-9e"/>
Apr 17 11:16:59 user nova-compute[82522]:     </interface>
Apr 17 11:16:59 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:16:59 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/console.log" append="off"/>
Apr 17 11:16:59 user nova-compute[82522]:     </serial>
Apr 17 11:16:59 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:16:59 user nova-compute[82522]:     <video>
Apr 17 11:16:59 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:16:59 user nova-compute[82522]:     </video>
Apr 17 11:16:59 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:16:59 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:16:59 user nova-compute[82522]:     </rng>
Apr 17 11:16:59 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:16:59 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:16:59 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:16:59 user nova-compute[82522]:     </memballoon>
Apr 17 11:16:59 user nova-compute[82522]:   </devices>
Apr 17 11:16:59 user nova-compute[82522]: </domain>
Apr 17 11:16:59 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-637753123',display_name='tempest-AttachVolumeNegativeTest-server-637753123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-637753123',id=45,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ4Ype3k6uIacOsZ33NhrfeIFHdyZIcZRaN0TXlDymXjIc8Dyf+mNPp09SUT3LS5aaOANPy6I0+2lJinYLQeC+jLmCKVpbkSlM1FGVIZC4ogZOM96rNuSPFeoOJZWp3Ug==',key_name='tempest-keypair-1991316860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-7s3emgka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=4368205b-a69c-49cd-958f-8f193856466a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:51:4e,bridge_name='br-int',has_traffic_filtering=True,id=0b6550cf-9e2a-4181-90de-34925655d07c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b6550cf-9e') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG os_vif [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:51:4e,bridge_name='br-int',has_traffic_filtering=True,id=0b6550cf-9e2a-4181-90de-34925655d07c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b6550cf-9e') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b6550cf-9e, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b6550cf-9e, col_values=(('external_ids', {'iface-id': '0b6550cf-9e2a-4181-90de-34925655d07c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:51:4e', 'vm-uuid': '4368205b-a69c-49cd-958f-8f193856466a'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:00 user nova-compute[82522]: INFO os_vif [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:51:4e,bridge_name='br-int',has_traffic_filtering=True,id=0b6550cf-9e2a-4181-90de-34925655d07c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b6550cf-9e')
Apr 17 11:17:00 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No VIF found with MAC fa:16:3e:8c:51:4e, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG nova.network.neutron [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updated VIF entry in instance network info cache for port 0b6550cf-9e2a-4181-90de-34925655d07c. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG nova.network.neutron [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updating instance_info_cache with network_info: [{"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:17:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] Releasing lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:17:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received event network-vif-plugged-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:17:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:17:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:17:01 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:17:01 user nova-compute[82522]: DEBUG nova.compute.manager [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] No waiting events found dispatching network-vif-plugged-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:17:01 user nova-compute[82522]: WARNING nova.compute.manager [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received unexpected event network-vif-plugged-0b6550cf-9e2a-4181-90de-34925655d07c for instance with vm_state building and task_state spawning.
Apr 17 11:17:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681730223.5976648, 4368205b-a69c-49cd-958f-8f193856466a => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:17:03 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] VM Resumed (Lifecycle Event)
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:17:03 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Instance spawned successfully.
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:17:03 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681730223.6017842, 4368205b-a69c-49cd-958f-8f193856466a => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:17:03 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] VM Started (Lifecycle Event)
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:17:03 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:17:03 user nova-compute[82522]: INFO nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Took 5.79 seconds to spawn the instance on the hypervisor.
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received event network-vif-plugged-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:17:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] No waiting events found dispatching network-vif-plugged-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:17:03 user nova-compute[82522]: WARNING nova.compute.manager [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received unexpected event network-vif-plugged-0b6550cf-9e2a-4181-90de-34925655d07c for instance with vm_state building and task_state spawning.
Apr 17 11:17:03 user nova-compute[82522]: INFO nova.compute.manager [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Took 6.31 seconds to build instance.
Apr 17 11:17:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.408s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:17:04 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:17:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:17:12 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:17:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:15 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:20 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:25 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:17:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:17:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:17:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:17:30 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:35 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:40 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:17:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:17:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:17:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:17:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:17:45 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:50 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:17:51 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:17:51 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:17:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=26.307235717773438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 4368205b-a69c-49cd-958f-8f193856466a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:17:51 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:17:52 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:17:52 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:17:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:17:53 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:17:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:17:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:17:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:17:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:17:55 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:17:55 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:17:55 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 4368205b-a69c-49cd-958f-8f193856466a {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updating instance_info_cache with network_info: [{"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:17:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:00 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:02 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:18:05 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:18:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:18:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:18:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:18:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:18:05 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:10 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "d7931d89-3448-4dab-92aa-9804d72363ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:11 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "d7931d89-3448-4dab-92aa-9804d72363ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:11 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:18:12 user nova-compute[82522]: INFO nova.compute.claims [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Claim successful on node user
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:18:12 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:18:12 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Creating image(s)
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "/opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "/opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.135s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk 1073741824" returned: 0 in 0.052s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.policy [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '819b4316675948e7b0bc8d05d47b57a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8e27f859154b75814c80a52166ba1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.134s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 11:18:12 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:13 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:13 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Cannot resize image /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 11:18:13 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lazy-loading 'migration_context' on Instance uuid d7931d89-3448-4dab-92aa-9804d72363ce {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:18:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 11:18:13 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Ensure instance console log exists: /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:18:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:13 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:13 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Successfully created port: 7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Successfully updated port: 7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "refresh_cache-d7931d89-3448-4dab-92aa-9804d72363ce" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquired lock "refresh_cache-d7931d89-3448-4dab-92aa-9804d72363ce" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received event network-changed-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.compute.manager [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Refreshing instance network info cache due to event network-changed-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] Acquiring lock "refresh_cache-d7931d89-3448-4dab-92aa-9804d72363ce" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.network.neutron [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Updating instance_info_cache with network_info: [{"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Releasing lock "refresh_cache-d7931d89-3448-4dab-92aa-9804d72363ce" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Instance network_info: |[{"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] Acquired lock "refresh_cache-d7931d89-3448-4dab-92aa-9804d72363ce" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.network.neutron [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Refreshing network info cache for port 7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Start _get_guest_xml network_info=[{"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:18:14 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:18:14 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1703499174',display_name='tempest-VolumesNegativeTest-instance-1703499174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1703499174',id=46,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8e27f859154b75814c80a52166ba1e',ramdisk_id='',reservation_id='r-2v20nh0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1239676705',owner_user_name='tempest-VolumesNegativeTest-1239676705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:18:12Z,user_data=None,user_id='819b4316675948e7b0bc8d05d47b57a3',uuid=d7931d89-3448-4dab-92aa-9804d72363ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Converting VIF {"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:14:ab,bridge_name='br-int',has_traffic_filtering=True,id=7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77,network=Network(85c55f59-1d17-4ab7-94cb-0eacc6e51014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7defac0f-e2') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lazy-loading 'pci_devices' on Instance uuid d7931d89-3448-4dab-92aa-9804d72363ce {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:18:14 user nova-compute[82522]:   <uuid>d7931d89-3448-4dab-92aa-9804d72363ce</uuid>
Apr 17 11:18:14 user nova-compute[82522]:   <name>instance-0000002e</name>
Apr 17 11:18:14 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:18:14 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:18:14 user nova-compute[82522]:   <metadata>
Apr 17 11:18:14 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:18:14 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:18:14 user nova-compute[82522]:       <nova:name>tempest-VolumesNegativeTest-instance-1703499174</nova:name>
Apr 17 11:18:14 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:18:14</nova:creationTime>
Apr 17 11:18:14 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:18:14 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:18:14 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:18:14 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:18:14 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:18:14 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:18:14 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:18:14 user nova-compute[82522]:       <nova:owner>
Apr 17 11:18:14 user nova-compute[82522]:         <nova:user uuid="819b4316675948e7b0bc8d05d47b57a3">tempest-VolumesNegativeTest-1239676705-project-member</nova:user>
Apr 17 11:18:14 user nova-compute[82522]:         <nova:project uuid="8b8e27f859154b75814c80a52166ba1e">tempest-VolumesNegativeTest-1239676705</nova:project>
Apr 17 11:18:14 user nova-compute[82522]:       </nova:owner>
Apr 17 11:18:14 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 11:18:14 user nova-compute[82522]:       <nova:ports>
Apr 17 11:18:14 user nova-compute[82522]:         <nova:port uuid="7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77">
Apr 17 11:18:14 user nova-compute[82522]:           <nova:ip type="fixed" address="192.168.233.193" ipVersion="4"/>
Apr 17 11:18:14 user nova-compute[82522]:         </nova:port>
Apr 17 11:18:14 user nova-compute[82522]:       </nova:ports>
Apr 17 11:18:14 user nova-compute[82522]:     </nova:instance>
Apr 17 11:18:14 user nova-compute[82522]:   </metadata>
Apr 17 11:18:14 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:18:14 user nova-compute[82522]:     <system>
Apr 17 11:18:14 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:18:14 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:18:14 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:18:14 user nova-compute[82522]:       <entry name="serial">d7931d89-3448-4dab-92aa-9804d72363ce</entry>
Apr 17 11:18:14 user nova-compute[82522]:       <entry name="uuid">d7931d89-3448-4dab-92aa-9804d72363ce</entry>
Apr 17 11:18:14 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:18:14 user nova-compute[82522]:     </system>
Apr 17 11:18:14 user nova-compute[82522]:   </sysinfo>
Apr 17 11:18:14 user nova-compute[82522]:   <os>
Apr 17 11:18:14 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:18:14 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:18:14 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:18:14 user nova-compute[82522]:   </os>
Apr 17 11:18:14 user nova-compute[82522]:   <features>
Apr 17 11:18:14 user nova-compute[82522]:     <acpi/>
Apr 17 11:18:14 user nova-compute[82522]:     <apic/>
Apr 17 11:18:14 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:18:14 user nova-compute[82522]:   </features>
Apr 17 11:18:14 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:18:14 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:18:14 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:18:14 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:18:14 user nova-compute[82522]:   </clock>
Apr 17 11:18:14 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:18:14 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:18:14 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:18:14 user nova-compute[82522]:   </cpu>
Apr 17 11:18:14 user nova-compute[82522]:   <devices>
Apr 17 11:18:14 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:18:14 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:18:14 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk"/>
Apr 17 11:18:14 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:18:14 user nova-compute[82522]:     </disk>
Apr 17 11:18:14 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:18:14 user nova-compute[82522]:       <mac address="fa:16:3e:f5:14:ab"/>
Apr 17 11:18:14 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:18:14 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:18:14 user nova-compute[82522]:       <target dev="tap7defac0f-e2"/>
Apr 17 11:18:14 user nova-compute[82522]:     </interface>
Apr 17 11:18:14 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:18:14 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/console.log" append="off"/>
Apr 17 11:18:14 user nova-compute[82522]:     </serial>
Apr 17 11:18:14 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:18:14 user nova-compute[82522]:     <video>
Apr 17 11:18:14 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:18:14 user nova-compute[82522]:     </video>
Apr 17 11:18:14 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:18:14 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:18:14 user nova-compute[82522]:     </rng>
Apr 17 11:18:14 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:18:14 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:18:14 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:18:14 user nova-compute[82522]:     </memballoon>
Apr 17 11:18:14 user nova-compute[82522]:   </devices>
Apr 17 11:18:14 user nova-compute[82522]: </domain>
Apr 17 11:18:14 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1703499174',display_name='tempest-VolumesNegativeTest-instance-1703499174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1703499174',id=46,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8e27f859154b75814c80a52166ba1e',ramdisk_id='',reservation_id='r-2v20nh0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1239676705',owner_user_name='tempest-VolumesNegativeTest-1239676705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:18:12Z,user_data=None,user_id='819b4316675948e7b0bc8d05d47b57a3',uuid=d7931d89-3448-4dab-92aa-9804d72363ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Converting VIF {"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:14:ab,bridge_name='br-int',has_traffic_filtering=True,id=7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77,network=Network(85c55f59-1d17-4ab7-94cb-0eacc6e51014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7defac0f-e2') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG os_vif [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:14:ab,bridge_name='br-int',has_traffic_filtering=True,id=7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77,network=Network(85c55f59-1d17-4ab7-94cb-0eacc6e51014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7defac0f-e2') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7defac0f-e2, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7defac0f-e2, col_values=(('external_ids', {'iface-id': '7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:14:ab', 'vm-uuid': 'd7931d89-3448-4dab-92aa-9804d72363ce'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:14 user nova-compute[82522]: INFO os_vif [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:14:ab,bridge_name='br-int',has_traffic_filtering=True,id=7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77,network=Network(85c55f59-1d17-4ab7-94cb-0eacc6e51014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7defac0f-e2')
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:18:14 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] No VIF found with MAC fa:16:3e:f5:14:ab, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:18:15 user nova-compute[82522]: DEBUG nova.network.neutron [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Updated VIF entry in instance network info cache for port 7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:18:15 user nova-compute[82522]: DEBUG nova.network.neutron [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Updating instance_info_cache with network_info: [{"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:18:15 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] Releasing lock "refresh_cache-d7931d89-3448-4dab-92aa-9804d72363ce" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG nova.compute.manager [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received event network-vif-plugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] Acquiring lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG nova.compute.manager [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] No waiting events found dispatching network-vif-plugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:18:16 user nova-compute[82522]: WARNING nova.compute.manager [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received unexpected event network-vif-plugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance with vm_state building and task_state spawning.
Apr 17 11:18:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:16 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681730298.262881, d7931d89-3448-4dab-92aa-9804d72363ce => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:18:18 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] VM Resumed (Lifecycle Event)
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:18:18 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Instance spawned successfully.
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:18:18 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681730298.2645173, d7931d89-3448-4dab-92aa-9804d72363ce => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:18:18 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] VM Started (Lifecycle Event)
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:18:18 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:18:18 user nova-compute[82522]: INFO nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:18:18 user nova-compute[82522]: INFO nova.compute.manager [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Took 6.42 seconds to build instance.
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received event network-vif-plugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] Acquiring lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:18 user nova-compute[82522]: DEBUG nova.compute.manager [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] No waiting events found dispatching network-vif-plugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:18:18 user nova-compute[82522]: WARNING nova.compute.manager [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received unexpected event network-vif-plugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance with vm_state active and task_state None.
Apr 17 11:18:18 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "d7931d89-3448-4dab-92aa-9804d72363ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.516s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:18:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:18:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:18:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:18:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:18:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received event network-changed-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:18:48 user nova-compute[82522]: DEBUG nova.compute.manager [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Refreshing instance network info cache due to event network-changed-0b6550cf-9e2a-4181-90de-34925655d07c. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:18:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] Acquiring lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:18:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] Acquired lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:18:48 user nova-compute[82522]: DEBUG nova.network.neutron [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Refreshing network info cache for port 0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:18:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updated VIF entry in instance network info cache for port 0b6550cf-9e2a-4181-90de-34925655d07c. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:18:50 user nova-compute[82522]: DEBUG nova.network.neutron [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updating instance_info_cache with network_info: [{"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:18:50 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] Releasing lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG nova.objects.instance [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'flavor' on Instance uuid 4368205b-a69c-49cd-958f-8f193856466a {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:52 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:53 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:18:53 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:18:53 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=26.285186767578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:18:53 user nova-compute[82522]: INFO nova.compute.manager [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Attaching volume 528310c6-770e-4d69-97cb-0ef4a7484760 to /dev/vdb
Apr 17 11:18:53 user nova-compute[82522]: DEBUG os_brick.utils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 4368205b-a69c-49cd-958f-8f193856466a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d7931d89-3448-4dab-92aa-9804d72363ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f8e9b-3efd-4251-b7ac-c426013dfd58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb88a38-108a-4551-a301-bb3dbcad4672]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31d046b-9b82-4dc9-881e-25d546005831]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dd4485-b818-4839-8c00-2bfbc62c0b17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:18:53 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4576af21-7713-425d-8a7c-b18714295d24]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG os_brick.utils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updating existing volume attachment record: a6e032a6-183e-4f1f-bf3f-7ee6a683fb1e {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:18:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 4368205b-a69c-49cd-958f-8f193856466a {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updating instance_info_cache with network_info: [{"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-4368205b-a69c-49cd-958f-8f193856466a" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDAQaFXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:18:57 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:18:57 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:18:57 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d49a66-9551-4542-a28e-e9b79c636e52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 11:18:57 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f019a085-16d8-4ace-8ccb-e5740cafd0bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760] added
Apr 17 11:18:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b53b569-e8d4-4648-8dba-6128729c6578]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e0629e-9fe5-49d6-b4b6-105820f21963]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDAQaFXG {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDAQaFXG" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b79f5-16e6-45b0-8a9f-e5a14eec65a8]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDAQaFXG'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6a677f-d347-45b7-839f-9fc05ff2d62b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7e1618-a8da-4218-a11f-96f19b567d4b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 17 11:18:57 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 17 11:18:57 user nova-compute[82522]:  {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:18:57 user nova-compute[82522]: WARNING os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 17 11:18:57 user nova-compute[82522]: 
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccd3bb9-6f8d-4375-8619-8ee018583785]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760, portal: 172.16.0.220,3260]
Apr 17 11:18:57 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760, portal: 172.16.0.220,3260] successful.
Apr 17 11:18:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[164af469-6543-4998-b273-96fb0fd4bd9c]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6da09fb-c399-42a6-bc1e-323e7c99b726]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 (non-flash)
Apr 17 11:18:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 (non-flash)
Apr 17 11:18:57 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b5cb96-2c0f-4713-8a9e-176bbdf3cbb3]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:18:57 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDAQaFXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 11:18:58 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:18:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:18:58 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23037626235333565', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:18:58 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037626235333565', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 11:18:59 user nova-compute[82522]: DEBUG nova.objects.instance [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'flavor' on Instance uuid 4368205b-a69c-49cd-958f-8f193856466a {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:18:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 11:18:59 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:18:59 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 11:18:59 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:18:59 user nova-compute[82522]:   <serial>528310c6-770e-4d69-97cb-0ef4a7484760</serial>
Apr 17 11:18:59 user nova-compute[82522]: </disk>
Apr 17 11:18:59 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 11:18:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:18:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:18:59 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No VIF found with MAC fa:16:3e:8c:51:4e, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:18:59 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.432s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:18:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:18:59 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:19:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:19:00 user nova-compute[82522]: INFO nova.compute.manager [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Detaching volume 528310c6-770e-4d69-97cb-0ef4a7484760
Apr 17 11:19:00 user nova-compute[82522]: INFO nova.virt.block_device [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Attempting to driver detach volume 528310c6-770e-4d69-97cb-0ef4a7484760 from mountpoint /dev/vdb
Apr 17 11:19:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Attempting to detach device vdb from instance 4368205b-a69c-49cd-958f-8f193856466a from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 11:19:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 11:19:00 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:19:00 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 11:19:00 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:19:00 user nova-compute[82522]:   <serial>528310c6-770e-4d69-97cb-0ef4a7484760</serial>
Apr 17 11:19:00 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 11:19:00 user nova-compute[82522]: </disk>
Apr 17 11:19:00 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 11:19:00 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully detached device vdb from instance 4368205b-a69c-49cd-958f-8f193856466a from the persistent domain config.
Apr 17 11:19:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4368205b-a69c-49cd-958f-8f193856466a from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 11:19:00 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 11:19:00 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:19:00 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 11:19:00 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:19:00 user nova-compute[82522]:   <serial>528310c6-770e-4d69-97cb-0ef4a7484760</serial>
Apr 17 11:19:00 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 11:19:00 user nova-compute[82522]: </disk>
Apr 17 11:19:00 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681730341.2224255, 4368205b-a69c-49cd-958f-8f193856466a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4368205b-a69c-49cd-958f-8f193856466a {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 11:19:01 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully detached device vdb from instance 4368205b-a69c-49cd-958f-8f193856466a from the live domain config.
Apr 17 11:19:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDAQaFXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:19:01 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5d9dd1-fb4d-4f42-871c-87055f6c5be5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 11:19:01 user nova-compute[82522]: No targets found.
Apr 17 11:19:01 user nova-compute[82522]: iSNS:
Apr 17 11:19:01 user nova-compute[82522]: No targets found.
Apr 17 11:19:01 user nova-compute[82522]: STATIC:
Apr 17 11:19:01 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760
Apr 17 11:19:01 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:19:01 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:19:01 user nova-compute[82522]: FIRMWARE:
Apr 17 11:19:01 user nova-compute[82522]: No targets found.
Apr 17 11:19:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 11:19:01 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 11:19:01 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b220466-d3ef-401d-b644-5a5a57d690ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4f94a0-4896-4c16-82c8-3bcbb6e127e9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 (non-flash)
Apr 17 11:19:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 (non-flash)
Apr 17 11:19:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2ac119360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea02f963-bcec-4a36-bd1a-d9f4adc6ae0b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[47855925-068f-4578-ad41-6f90fd9a159f]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455e8e2-f099-42c0-b8b3-2df07cb64af7]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac7676e-aa80-4147-8e36-0e519a2df0b0]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65a2397-d55a-4e06-b734-d13c07149673]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c08f66-aea4-4036-95d6-0955b69808c2]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760, portal: 172.16.0.220,3260]
Apr 17 11:19:01 user nova-compute[82522]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760, portal: 172.16.0.220,3260] successful.
Apr 17 11:19:01 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528310c6-770e-4d69-97cb-0ef4a7484760 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7452b3cb-a756-477b-aa40-d82909abac78]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] <== disconnect_volume: return (270ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:19:01 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 11:19:02 user nova-compute[82522]: DEBUG nova.objects.instance [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'flavor' on Instance uuid 4368205b-a69c-49cd-958f-8f193856466a {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:19:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.574s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:19:04 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:19:04 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:19:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:06 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:19:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:19:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:19:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:19:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:19:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:16 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:19:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:19:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:24 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:19:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:19:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:19:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:19:29 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:19:34 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:19:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:19:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:19:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:19:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:19:51 user nova-compute[82522]: INFO nova.compute.manager [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Terminating instance
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received event network-vif-unplugged-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] No waiting events found dispatching network-vif-unplugged-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received event network-vif-unplugged-0b6550cf-9e2a-4181-90de-34925655d07c for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Instance destroyed successfully.
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.objects.instance [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'resources' on Instance uuid 4368205b-a69c-49cd-958f-8f193856466a {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-637753123',display_name='tempest-AttachVolumeNegativeTest-server-637753123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-637753123',id=45,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ4Ype3k6uIacOsZ33NhrfeIFHdyZIcZRaN0TXlDymXjIc8Dyf+mNPp09SUT3LS5aaOANPy6I0+2lJinYLQeC+jLmCKVpbkSlM1FGVIZC4ogZOM96rNuSPFeoOJZWp3Ug==',key_name='tempest-keypair-1991316860',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:17:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-7s3emgka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:17:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=4368205b-a69c-49cd-958f-8f193856466a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "0b6550cf-9e2a-4181-90de-34925655d07c", "address": "fa:16:3e:8c:51:4e", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6550cf-9e", "ovs_interfaceid": "0b6550cf-9e2a-4181-90de-34925655d07c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:51:4e,bridge_name='br-int',has_traffic_filtering=True,id=0b6550cf-9e2a-4181-90de-34925655d07c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b6550cf-9e') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG os_vif [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:51:4e,bridge_name='br-int',has_traffic_filtering=True,id=0b6550cf-9e2a-4181-90de-34925655d07c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b6550cf-9e') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b6550cf-9e, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:19:51 user nova-compute[82522]: INFO os_vif [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:51:4e,bridge_name='br-int',has_traffic_filtering=True,id=0b6550cf-9e2a-4181-90de-34925655d07c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b6550cf-9e')
Apr 17 11:19:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Deleting instance files /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a_del
Apr 17 11:19:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Deletion of /opt/stack/data/nova/instances/4368205b-a69c-49cd-958f-8f193856466a_del complete
Apr 17 11:19:51 user nova-compute[82522]: INFO nova.compute.manager [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 17 11:19:51 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:19:51 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 4368205b-a69c-49cd-958f-8f193856466a] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:19:52 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:19:52 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:19:52 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Took 0.85 seconds to deallocate network for instance.
Apr 17 11:19:52 user nova-compute[82522]: DEBUG nova.compute.manager [req-d7a1c032-831f-4387-acf9-f4f21fcf532e req-fcc7ee40-9143-45d5-8c62-eb82602ac77b service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received event network-vif-deleted-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:19:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:19:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:19:52 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:19:52 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:19:52 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:19:52 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Deleted allocations for instance 4368205b-a69c-49cd-958f-8f193856466a
Apr 17 11:19:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "4368205b-a69c-49cd-958f-8f193856466a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.020s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:19:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received event network-vif-plugged-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:19:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] Acquiring lock "4368205b-a69c-49cd-958f-8f193856466a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:19:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:19:53 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] Lock "4368205b-a69c-49cd-958f-8f193856466a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:19:53 user nova-compute[82522]: DEBUG nova.compute.manager [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] No waiting events found dispatching network-vif-plugged-0b6550cf-9e2a-4181-90de-34925655d07c {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:19:53 user nova-compute[82522]: WARNING nova.compute.manager [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Received unexpected event network-vif-plugged-0b6550cf-9e2a-4181-90de-34925655d07c for instance with vm_state deleted and task_state None.
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:19:54 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:19:54 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:19:54 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=26.303752899169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance d7931d89-3448-4dab-92aa-9804d72363ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:19:54 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:19:55 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:19:55 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:19:56 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-d7931d89-3448-4dab-92aa-9804d72363ce" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-d7931d89-3448-4dab-92aa-9804d72363ce" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Updating instance_info_cache with network_info: [{"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-d7931d89-3448-4dab-92aa-9804d72363ce" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:19:58 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:20:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "d7931d89-3448-4dab-92aa-9804d72363ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "d7931d89-3448-4dab-92aa-9804d72363ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:02 user nova-compute[82522]: INFO nova.compute.manager [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Terminating instance
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received event network-vif-unplugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] Acquiring lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] No waiting events found dispatching network-vif-unplugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.compute.manager [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received event network-vif-unplugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:02 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Instance destroyed successfully.
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.objects.instance [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lazy-loading 'resources' on Instance uuid d7931d89-3448-4dab-92aa-9804d72363ce {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1703499174',display_name='tempest-VolumesNegativeTest-instance-1703499174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1703499174',id=46,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:18:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8e27f859154b75814c80a52166ba1e',ramdisk_id='',reservation_id='r-2v20nh0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1239676705',owner_user_name='tempest-VolumesNegativeTest-1239676705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:18:18Z,user_data=None,user_id='819b4316675948e7b0bc8d05d47b57a3',uuid=d7931d89-3448-4dab-92aa-9804d72363ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Converting VIF {"id": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "address": "fa:16:3e:f5:14:ab", "network": {"id": "85c55f59-1d17-4ab7-94cb-0eacc6e51014", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2477ba1af887431e84938a7e8ce70cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7defac0f-e2", "ovs_interfaceid": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:14:ab,bridge_name='br-int',has_traffic_filtering=True,id=7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77,network=Network(85c55f59-1d17-4ab7-94cb-0eacc6e51014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7defac0f-e2') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG os_vif [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:14:ab,bridge_name='br-int',has_traffic_filtering=True,id=7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77,network=Network(85c55f59-1d17-4ab7-94cb-0eacc6e51014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7defac0f-e2') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7defac0f-e2, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:20:02 user nova-compute[82522]: INFO os_vif [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:14:ab,bridge_name='br-int',has_traffic_filtering=True,id=7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77,network=Network(85c55f59-1d17-4ab7-94cb-0eacc6e51014),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7defac0f-e2')
Apr 17 11:20:02 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Deleting instance files /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce_del
Apr 17 11:20:02 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Deletion of /opt/stack/data/nova/instances/d7931d89-3448-4dab-92aa-9804d72363ce_del complete
Apr 17 11:20:02 user nova-compute[82522]: INFO nova.compute.manager [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 17 11:20:02 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:20:02 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:20:03 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:20:03 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Took 0.53 seconds to deallocate network for instance.
Apr 17 11:20:03 user nova-compute[82522]: DEBUG nova.compute.manager [req-b062c955-0f3a-4de9-bbc8-50bae4be91e4 req-b1d7daa8-03d4-4585-91ec-6e52a04a538f service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received event network-vif-deleted-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:20:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:03 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:20:03 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:20:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:03 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Deleted allocations for instance d7931d89-3448-4dab-92aa-9804d72363ce
Apr 17 11:20:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "d7931d89-3448-4dab-92aa-9804d72363ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.475s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received event network-vif-plugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:20:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] Acquiring lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:04 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] Lock "d7931d89-3448-4dab-92aa-9804d72363ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:04 user nova-compute[82522]: DEBUG nova.compute.manager [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] No waiting events found dispatching network-vif-plugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:20:04 user nova-compute[82522]: WARNING nova.compute.manager [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Received unexpected event network-vif-plugged-7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance with vm_state deleted and task_state None.
Apr 17 11:20:06 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:20:06 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:20:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:20:06 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681730391.808, 4368205b-a69c-49cd-958f-8f193856466a => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:20:06 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 4368205b-a69c-49cd-958f-8f193856466a] VM Stopped (Lifecycle Event)
Apr 17 11:20:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-c5fd8cf5-3adf-45d6-b758-5e2159fa4c23 None None] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:20:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:20:17 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681730402.670153, d7931d89-3448-4dab-92aa-9804d72363ce => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:20:17 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] VM Stopped (Lifecycle Event)
Apr 17 11:20:17 user nova-compute[82522]: DEBUG nova.compute.manager [None req-b1262786-8461-440a-b9d3-d4dd5de50b95 None None] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:20:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:20:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:20:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:20:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:20:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:20:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:43 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:20:43 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 11:20:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:44 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:44 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Starting instance... {{(pid=82522) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82522) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 11:20:45 user nova-compute[82522]: INFO nova.compute.claims [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Claim successful on node user
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Start building networks asynchronously for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Allocating IP information in the background. {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.network.neutron [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] allocate_for_instance() {{(pid=82522) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 11:20:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Start building block device mappings for instance. {{(pid=82522) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.policy [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82522) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Start spawning the instance on the hypervisor. {{(pid=82522) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Creating instance directory {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 11:20:45 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Creating image(s)
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "/opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "/opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.148s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk 1073741824 {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853,backing_fmt=raw /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk 1073741824" returned: 0 in 0.051s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "45e0d896a326a0fee71aedd708b2e06e56cfc853" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45e0d896a326a0fee71aedd708b2e06e56cfc853 --force-share --output=json" returned: 0 in 0.131s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk. size=1073741824 {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 11:20:45 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.virt.disk.api [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Cannot resize image /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk to a smaller size. {{(pid=82522) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.objects.instance [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'migration_context' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.network.neutron [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Successfully created port: 765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Created local disks {{(pid=82522) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Ensure instance console log exists: /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/console.log {{(pid=82522) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.network.neutron [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Successfully updated port: 765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquired lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.network.neutron [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Building network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received event network-changed-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.compute.manager [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Refreshing instance network info cache due to event network-changed-765fd187-4075-424c-a90f-4d1b86dadf0c. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] Acquiring lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:20:46 user nova-compute[82522]: DEBUG nova.network.neutron [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Instance cache missing network info. {{(pid=82522) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.network.neutron [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updating instance_info_cache with network_info: [{"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Releasing lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Instance network_info: |[{"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82522) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] Acquired lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.network.neutron [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Refreshing network info cache for port 765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Start _get_guest_xml network_info=[{"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '66764afd-311a-41a0-a068-b2937b23acba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 11:20:47 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:20:47 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82522) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T10:31:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T10:30:36Z,direct_url=<?>,disk_format='qcow2',id=66764afd-311a-41a0-a068-b2937b23acba,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2477ba1af887431e84938a7e8ce70cbb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T10:30:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image limits 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image pref 0:0:0 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Got 1 possible topologies {{(pid=82522) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82522) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1614419249',display_name='tempest-AttachVolumeNegativeTest-server-1614419249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1614419249',id=47,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4qah2EQ3/gXG23uGEJJi0SjaHzeSRjRdYjX7zfo8aLMEzvLdldhA8sGlVvRr0dPEc9Xfo5Hxf2kd/lwfKx9bue55cGB8lLxsLq2PmxzqElILsQT1hzHCO8ZJZmWCbh9A==',key_name='tempest-keypair-968594398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-0k0x4xuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=0dcc9a9e-af00-4f79-add0-f4034f649818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82522) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:78:e0,bridge_name='br-int',has_traffic_filtering=True,id=765fd187-4075-424c-a90f-4d1b86dadf0c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765fd187-40') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.objects.instance [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] End _get_guest_xml xml=<domain type="kvm">
Apr 17 11:20:47 user nova-compute[82522]:   <uuid>0dcc9a9e-af00-4f79-add0-f4034f649818</uuid>
Apr 17 11:20:47 user nova-compute[82522]:   <name>instance-0000002f</name>
Apr 17 11:20:47 user nova-compute[82522]:   <memory>131072</memory>
Apr 17 11:20:47 user nova-compute[82522]:   <vcpu>1</vcpu>
Apr 17 11:20:47 user nova-compute[82522]:   <metadata>
Apr 17 11:20:47 user nova-compute[82522]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 11:20:47 user nova-compute[82522]:       <nova:package version="0.0.0"/>
Apr 17 11:20:47 user nova-compute[82522]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1614419249</nova:name>
Apr 17 11:20:47 user nova-compute[82522]:       <nova:creationTime>2023-04-17 11:20:47</nova:creationTime>
Apr 17 11:20:47 user nova-compute[82522]:       <nova:flavor name="m1.nano">
Apr 17 11:20:47 user nova-compute[82522]:         <nova:memory>128</nova:memory>
Apr 17 11:20:47 user nova-compute[82522]:         <nova:disk>1</nova:disk>
Apr 17 11:20:47 user nova-compute[82522]:         <nova:swap>0</nova:swap>
Apr 17 11:20:47 user nova-compute[82522]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 11:20:47 user nova-compute[82522]:         <nova:vcpus>1</nova:vcpus>
Apr 17 11:20:47 user nova-compute[82522]:       </nova:flavor>
Apr 17 11:20:47 user nova-compute[82522]:       <nova:owner>
Apr 17 11:20:47 user nova-compute[82522]:         <nova:user uuid="8fc272a75798487d84beedfa65775423">tempest-AttachVolumeNegativeTest-60160992-project-member</nova:user>
Apr 17 11:20:47 user nova-compute[82522]:         <nova:project uuid="64eccc3b86914e4ab735b79c4b53a142">tempest-AttachVolumeNegativeTest-60160992</nova:project>
Apr 17 11:20:47 user nova-compute[82522]:       </nova:owner>
Apr 17 11:20:47 user nova-compute[82522]:       <nova:root type="image" uuid="66764afd-311a-41a0-a068-b2937b23acba"/>
Apr 17 11:20:47 user nova-compute[82522]:       <nova:ports>
Apr 17 11:20:47 user nova-compute[82522]:         <nova:port uuid="765fd187-4075-424c-a90f-4d1b86dadf0c">
Apr 17 11:20:47 user nova-compute[82522]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 17 11:20:47 user nova-compute[82522]:         </nova:port>
Apr 17 11:20:47 user nova-compute[82522]:       </nova:ports>
Apr 17 11:20:47 user nova-compute[82522]:     </nova:instance>
Apr 17 11:20:47 user nova-compute[82522]:   </metadata>
Apr 17 11:20:47 user nova-compute[82522]:   <sysinfo type="smbios">
Apr 17 11:20:47 user nova-compute[82522]:     <system>
Apr 17 11:20:47 user nova-compute[82522]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 11:20:47 user nova-compute[82522]:       <entry name="product">OpenStack Nova</entry>
Apr 17 11:20:47 user nova-compute[82522]:       <entry name="version">0.0.0</entry>
Apr 17 11:20:47 user nova-compute[82522]:       <entry name="serial">0dcc9a9e-af00-4f79-add0-f4034f649818</entry>
Apr 17 11:20:47 user nova-compute[82522]:       <entry name="uuid">0dcc9a9e-af00-4f79-add0-f4034f649818</entry>
Apr 17 11:20:47 user nova-compute[82522]:       <entry name="family">Virtual Machine</entry>
Apr 17 11:20:47 user nova-compute[82522]:     </system>
Apr 17 11:20:47 user nova-compute[82522]:   </sysinfo>
Apr 17 11:20:47 user nova-compute[82522]:   <os>
Apr 17 11:20:47 user nova-compute[82522]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 11:20:47 user nova-compute[82522]:     <boot dev="hd"/>
Apr 17 11:20:47 user nova-compute[82522]:     <smbios mode="sysinfo"/>
Apr 17 11:20:47 user nova-compute[82522]:   </os>
Apr 17 11:20:47 user nova-compute[82522]:   <features>
Apr 17 11:20:47 user nova-compute[82522]:     <acpi/>
Apr 17 11:20:47 user nova-compute[82522]:     <apic/>
Apr 17 11:20:47 user nova-compute[82522]:     <vmcoreinfo/>
Apr 17 11:20:47 user nova-compute[82522]:   </features>
Apr 17 11:20:47 user nova-compute[82522]:   <clock offset="utc">
Apr 17 11:20:47 user nova-compute[82522]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 11:20:47 user nova-compute[82522]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 11:20:47 user nova-compute[82522]:     <timer name="hpet" present="no"/>
Apr 17 11:20:47 user nova-compute[82522]:   </clock>
Apr 17 11:20:47 user nova-compute[82522]:   <cpu mode="custom" match="exact">
Apr 17 11:20:47 user nova-compute[82522]:     <model>Nehalem</model>
Apr 17 11:20:47 user nova-compute[82522]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 11:20:47 user nova-compute[82522]:   </cpu>
Apr 17 11:20:47 user nova-compute[82522]:   <devices>
Apr 17 11:20:47 user nova-compute[82522]:     <disk type="file" device="disk">
Apr 17 11:20:47 user nova-compute[82522]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 11:20:47 user nova-compute[82522]:       <source file="/opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk"/>
Apr 17 11:20:47 user nova-compute[82522]:       <target dev="vda" bus="virtio"/>
Apr 17 11:20:47 user nova-compute[82522]:     </disk>
Apr 17 11:20:47 user nova-compute[82522]:     <interface type="ethernet">
Apr 17 11:20:47 user nova-compute[82522]:       <mac address="fa:16:3e:1b:78:e0"/>
Apr 17 11:20:47 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:20:47 user nova-compute[82522]:       <mtu size="1442"/>
Apr 17 11:20:47 user nova-compute[82522]:       <target dev="tap765fd187-40"/>
Apr 17 11:20:47 user nova-compute[82522]:     </interface>
Apr 17 11:20:47 user nova-compute[82522]:     <serial type="pty">
Apr 17 11:20:47 user nova-compute[82522]:       <log file="/opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/console.log" append="off"/>
Apr 17 11:20:47 user nova-compute[82522]:     </serial>
Apr 17 11:20:47 user nova-compute[82522]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 11:20:47 user nova-compute[82522]:     <video>
Apr 17 11:20:47 user nova-compute[82522]:       <model type="virtio"/>
Apr 17 11:20:47 user nova-compute[82522]:     </video>
Apr 17 11:20:47 user nova-compute[82522]:     <rng model="virtio">
Apr 17 11:20:47 user nova-compute[82522]:       <backend model="random">/dev/urandom</backend>
Apr 17 11:20:47 user nova-compute[82522]:     </rng>
Apr 17 11:20:47 user nova-compute[82522]:     <controller type="usb" index="0" model="none"/>
Apr 17 11:20:47 user nova-compute[82522]:     <memballoon model="virtio">
Apr 17 11:20:47 user nova-compute[82522]:       <stats period="10"/>
Apr 17 11:20:47 user nova-compute[82522]:     </memballoon>
Apr 17 11:20:47 user nova-compute[82522]:   </devices>
Apr 17 11:20:47 user nova-compute[82522]: </domain>
Apr 17 11:20:47 user nova-compute[82522]:  {{(pid=82522) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1614419249',display_name='tempest-AttachVolumeNegativeTest-server-1614419249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1614419249',id=47,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4qah2EQ3/gXG23uGEJJi0SjaHzeSRjRdYjX7zfo8aLMEzvLdldhA8sGlVvRr0dPEc9Xfo5Hxf2kd/lwfKx9bue55cGB8lLxsLq2PmxzqElILsQT1hzHCO8ZJZmWCbh9A==',key_name='tempest-keypair-968594398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-0k0x4xuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T11:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=0dcc9a9e-af00-4f79-add0-f4034f649818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:78:e0,bridge_name='br-int',has_traffic_filtering=True,id=765fd187-4075-424c-a90f-4d1b86dadf0c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765fd187-40') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG os_vif [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:78:e0,bridge_name='br-int',has_traffic_filtering=True,id=765fd187-4075-424c-a90f-4d1b86dadf0c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765fd187-40') {{(pid=82522) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap765fd187-40, may_exist=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap765fd187-40, col_values=(('external_ids', {'iface-id': '765fd187-4075-424c-a90f-4d1b86dadf0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:78:e0', 'vm-uuid': '0dcc9a9e-af00-4f79-add0-f4034f649818'}),)) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:47 user nova-compute[82522]: INFO os_vif [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:78:e0,bridge_name='br-int',has_traffic_filtering=True,id=765fd187-4075-424c-a90f-4d1b86dadf0c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765fd187-40')
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:20:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No VIF found with MAC fa:16:3e:1b:78:e0, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:20:48 user nova-compute[82522]: DEBUG nova.network.neutron [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updated VIF entry in instance network info cache for port 765fd187-4075-424c-a90f-4d1b86dadf0c. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:20:48 user nova-compute[82522]: DEBUG nova.network.neutron [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updating instance_info_cache with network_info: [{"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:20:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] Releasing lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received event network-vif-plugged-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG nova.compute.manager [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] No waiting events found dispatching network-vif-plugged-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:20:49 user nova-compute[82522]: WARNING nova.compute.manager [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received unexpected event network-vif-plugged-765fd187-4075-424c-a90f-4d1b86dadf0c for instance with vm_state building and task_state spawning.
Apr 17 11:20:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:49 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681730451.2725186, 0dcc9a9e-af00-4f79-add0-f4034f649818 => Resumed> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:20:51 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] VM Resumed (Lifecycle Event)
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Instance event wait completed in 0 seconds for  {{(pid=82522) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Guest created on hypervisor {{(pid=82522) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 11:20:51 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Instance spawned successfully.
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Found default for hw_cdrom_bus of ide {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Found default for hw_disk_bus of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Found default for hw_input_bus of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Found default for hw_pointer_model of None {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Found default for hw_video_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Found default for hw_vif_model of virtio {{(pid=82522) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 11:20:51 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.virt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Emitting event <LifecycleEvent: 1681730451.2759717, 0dcc9a9e-af00-4f79-add0-f4034f649818 => Started> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:20:51 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] VM Started (Lifecycle Event)
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received event network-vif-plugged-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.compute.manager [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] No waiting events found dispatching network-vif-plugged-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:20:51 user nova-compute[82522]: WARNING nova.compute.manager [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received unexpected event network-vif-plugged-765fd187-4075-424c-a90f-4d1b86dadf0c for instance with vm_state building and task_state spawning.
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82522) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 11:20:51 user nova-compute[82522]: INFO nova.compute.manager [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 11:20:51 user nova-compute[82522]: INFO nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Took 5.91 seconds to spawn the instance on the hypervisor.
Apr 17 11:20:51 user nova-compute[82522]: DEBUG nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:20:51 user nova-compute[82522]: INFO nova.compute.manager [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Took 6.43 seconds to build instance.
Apr 17 11:20:51 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.556s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:53 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:20:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:55 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:20:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:20:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:20:56 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=26.321216583251953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:20:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:20:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:20:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:20:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:20:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:20:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:20:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:20:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:20:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:20:59 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:20:59 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:20:59 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updating instance_info_cache with network_info: [{"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:21:00 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:21:01 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:04 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:05 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:06 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:06 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:21:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:08 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:08 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 11:21:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] There are 0 instances to clean {{(pid=82522) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 11:21:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:21:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:21:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:21:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:21:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:21:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:21:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:21:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:21:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:21:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:21:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:21:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:21:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:21:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:21:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:21:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:21:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:55 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:21:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:21:56 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:21:56 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=26.291175842285156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:21:56 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing inventories for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating ProviderTree inventory for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Updating inventory in ProviderTree for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing aggregate associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, aggregates: None {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Refreshing trait associations for resource provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI {{(pid=82522) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:21:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:22:00 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:00 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:01 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updating instance_info_cache with network_info: [{"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:22:02 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:22:07 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:07 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:22:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:09 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:22:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:22:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:14 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:20 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:20 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Triggering sync for uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 11:22:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:22:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:22:20 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:22:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:22:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:22:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:22:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:22:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:22:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received event network-changed-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:22:36 user nova-compute[82522]: DEBUG nova.compute.manager [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Refreshing instance network info cache due to event network-changed-765fd187-4075-424c-a90f-4d1b86dadf0c. {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 11:22:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] Acquiring lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:22:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] Acquired lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:22:36 user nova-compute[82522]: DEBUG nova.network.neutron [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Refreshing network info cache for port 765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 11:22:36 user nova-compute[82522]: DEBUG nova.network.neutron [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updated VIF entry in instance network info cache for port 765fd187-4075-424c-a90f-4d1b86dadf0c. {{(pid=82522) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 11:22:36 user nova-compute[82522]: DEBUG nova.network.neutron [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updating instance_info_cache with network_info: [{"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:22:36 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] Releasing lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:22:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:22:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:22:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:22:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:22:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:22:38 user nova-compute[82522]: DEBUG nova.objects.instance [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'flavor' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:22:38 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:22:39 user nova-compute[82522]: INFO nova.compute.manager [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Attaching volume e7377e17-365c-4d28-abbd-013c80b6308f to /dev/vdb
Apr 17 11:22:39 user nova-compute[82522]: DEBUG os_brick.utils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a27a1b-dfc2-4d7c-9c82-f33bfbbd9d29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:64d38b24813f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e63a6cb-e499-4442-95dc-de59614b0844]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e42b563-fd51-47cd-99a1-587bf54a9ae3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7209f1d-0597-4a74-809a-45fe7b830951]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Running cmd (subprocess): nvme version {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 'nvme version' failed. Not Retrying. {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.nvmeof [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] nvme not present on system {{(pid=82522) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 11:22:39 user nova-compute[82522]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 11:22:39 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aede61b-22b8-425f-b63c-499f7f72db67]: (4, '') {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82522) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.lightos [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] LIGHTOS: no hostnqn found. {{(pid=82522) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG os_brick.utils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:64d38b24813f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG nova.virt.block_device [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updating existing volume attachment record: 32dc6ada-c89d-478d-be8a-57ef43a4a587 {{(pid=82522) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 11:22:39 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:42 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Calling os-brick to attach iSCSI Volume {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YodsDxEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:22:43 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:22:43 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:22:43 user nova-compute[82522]: INFO os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd00b0a-24bd-49ed-b819-e3a5e83f07ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 11:22:43 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --interface default --op new {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3208d0-5b99-47ed-a866-e4a425fb9eb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f] added\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f] added
Apr 17 11:22:43 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c4c4e-85ae-4953-917f-cfde76ff9a22]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b4cf60-ad18-4838-bc11-8454c14e1cb2]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YodsDxEQ {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YodsDxEQ" returned: 0 in 0.022s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d2daf4-caf1-4c07-b671-62b46d8b7781]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YodsDxEQ'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce5be3d-8e23-4b43-a32c-f151756894b5]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[567cb413-5a65-4045-8413-868f140dade3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 17 11:22:43 user nova-compute[82522]:  {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:22:43 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 17 11:22:43 user nova-compute[82522]:  {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:22:43 user nova-compute[82522]: WARNING os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 17 11:22:43 user nova-compute[82522]: 
Apr 17 11:22:43 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --login {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf81bf99-7683-4a6f-9a08-86335f44fbad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f, portal: 172.16.0.220,3260]
Apr 17 11:22:44 user nova-compute[82522]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f, portal: 172.16.0.220,3260] successful.
Apr 17 11:22:44 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a88c2e-7010-4ebe-b14f-b239db21db25]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb19510f-6f5c-45c9-8ec0-772cb5710585]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f (non-flash)
Apr 17 11:22:44 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f (non-flash)
Apr 17 11:22:44 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Connected to 172.16.0.220:3260 {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=82522) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82522) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65a5992-f4a7-4ea3-a5e1-20569e564ef0]: (4, ('- - 0', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82522) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YodsDxEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82522) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 11:22:44 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:45 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:22:45 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23236323137386663', 'path': '/dev/sdb'} {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:22:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236323137386663', 'path': '/dev/sdb'} {{(pid=82522) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 11:22:45 user nova-compute[82522]: DEBUG nova.objects.instance [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'flavor' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:22:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 11:22:45 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:22:45 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 11:22:45 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:22:45 user nova-compute[82522]:   <serial>e7377e17-365c-4d28-abbd-013c80b6308f</serial>
Apr 17 11:22:45 user nova-compute[82522]: </disk>
Apr 17 11:22:45 user nova-compute[82522]:  {{(pid=82522) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 11:22:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vda, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:22:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82522) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 11:22:45 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] No VIF found with MAC fa:16:3e:1b:78:e0, not building metadata {{(pid=82522) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 11:22:45 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.691s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:22:47 user nova-compute[82522]: INFO nova.compute.manager [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Detaching volume e7377e17-365c-4d28-abbd-013c80b6308f
Apr 17 11:22:47 user nova-compute[82522]: INFO nova.virt.block_device [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Attempting to driver detach volume e7377e17-365c-4d28-abbd-013c80b6308f from mountpoint /dev/vdb
Apr 17 11:22:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Attempting to detach device vdb from instance 0dcc9a9e-af00-4f79-add0-f4034f649818 from the persistent domain config. {{(pid=82522) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 11:22:47 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:22:47 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 11:22:47 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:22:47 user nova-compute[82522]:   <serial>e7377e17-365c-4d28-abbd-013c80b6308f</serial>
Apr 17 11:22:47 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 11:22:47 user nova-compute[82522]: </disk>
Apr 17 11:22:47 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 11:22:47 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully detached device vdb from instance 0dcc9a9e-af00-4f79-add0-f4034f649818 from the persistent domain config.
Apr 17 11:22:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dcc9a9e-af00-4f79-add0-f4034f649818 from the live domain config. {{(pid=82522) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.guest [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 11:22:47 user nova-compute[82522]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 11:22:47 user nova-compute[82522]:   <source dev="/dev/sdb"/>
Apr 17 11:22:47 user nova-compute[82522]:   <target dev="vdb" bus="virtio"/>
Apr 17 11:22:47 user nova-compute[82522]:   <serial>e7377e17-365c-4d28-abbd-013c80b6308f</serial>
Apr 17 11:22:47 user nova-compute[82522]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 11:22:47 user nova-compute[82522]: </disk>
Apr 17 11:22:47 user nova-compute[82522]:  {{(pid=82522) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-ceea1833-f621-452b-a991-43f1d21ad4c0 None None] Received event <DeviceRemovedEvent: 1681730567.736249, 0dcc9a9e-af00-4f79-add0-f4034f649818 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82522) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.driver [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 11:22:47 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully detached device vdb from instance 0dcc9a9e-af00-4f79-add0-f4034f649818 from the live domain config.
Apr 17 11:22:47 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] calling os-brick to detach iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa2845018d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YodsDxEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 11:22:47 user nova-compute[82522]: WARNING os_brick.initiator.connectors.base [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c2ceae-e898-4612-8bf0-59494318c312]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 11:22:47 user nova-compute[82522]: No targets found.
Apr 17 11:22:47 user nova-compute[82522]: iSNS:
Apr 17 11:22:47 user nova-compute[82522]: No targets found.
Apr 17 11:22:47 user nova-compute[82522]: STATIC:
Apr 17 11:22:47 user nova-compute[82522]: Target: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f
Apr 17 11:22:47 user nova-compute[82522]:         Portal: 172.16.0.220:3260,-1
Apr 17 11:22:47 user nova-compute[82522]:                 Iface Name: default
Apr 17 11:22:47 user nova-compute[82522]: FIRMWARE:
Apr 17 11:22:47 user nova-compute[82522]: No targets found.
Apr 17 11:22:47 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 11:22:47 user nova-compute[82522]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 11:22:47 user nova-compute[82522]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82522) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f', 0)] {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[be04f378-07a0-424d-b45c-ffbc77c058b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f226b1-f507-4042-b93b-98656cf9ec7d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f (non-flash)\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f (non-flash)
Apr 17 11:22:47 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f (non-flash)
Apr 17 11:22:47 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa2843b9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f'): ({'sdb'}, set())}) {{(pid=82522) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Removing single pathed devices sdb {{(pid=82522) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b01b2a1-8a9c-459b-8732-6f219318077f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[207dcd3d-62ca-42fa-bad9-82cff2daaaf8]: (4, ('ok\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flushing IO for device /dev/sdb {{(pid=82522) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff916d2-7e85-43d4-a8c5-3ae09e6c0d85]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82522) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dadebc-1a0f-4f6a-b148-67e82d029f0f]: (4, ('1', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.linuxscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] SCSI volumes sdb have been removed. {{(pid=82522) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f')] {{(pid=82522) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f638f9-d894-4dee-a7fd-697df2c22c3b]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:47 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --logout {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3370f89-ebf0-468a-bce8-2e0688204a99]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f, portal: 172.16.0.220,3260]
Apr 17 11:22:48 user nova-compute[82522]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f, portal: 172.16.0.220,3260] successful.
Apr 17 11:22:48 user nova-compute[82522]:  stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op delete {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7377e17-365c-4d28-abbd-013c80b6308f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92652) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b1c0b-fd54-43f8-9d14-877607f80397]: (4, ('', '')) {{(pid=92652) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82522) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.base [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] <== disconnect_volume: return (346ms) None {{(pid=82522) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Disconnected iSCSI Volume {{(pid=82522) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG nova.objects.instance [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'flavor' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:22:48 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.897s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:22:52 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:22:54 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:54 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_concurrency.processutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82522) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:22:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:22:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:22:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=26.290081024169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82522) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:22:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:22:58 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:22:58 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:22:58 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:22:58 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:23:01 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:01 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:02 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:23:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:23:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:23:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:23:02 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquired lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Forcefully refreshing network info cache for instance {{(pid=82522) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG nova.objects.instance [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lazy-loading 'info_cache' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG nova.network.neutron [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updating instance_info_cache with network_info: [{"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Releasing lock "refresh_cache-0dcc9a9e-af00-4f79-add0-f4034f649818" {{(pid=82522) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 11:23:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updated the network info_cache for instance {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 11:23:07 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:23:08 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:08 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:23:09 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:12 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:17 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:23:19 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:22 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:23:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:23:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:23:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:23:27 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:23:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:23:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:23:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:23:32 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:23:37 user nova-compute[82522]: INFO nova.compute.manager [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Terminating instance
Apr 17 11:23:37 user nova-compute[82522]: DEBUG nova.compute.manager [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Start destroying the instance on the hypervisor. {{(pid=82522) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received event network-vif-unplugged-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] No waiting events found dispatching network-vif-unplugged-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG nova.compute.manager [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received event network-vif-unplugged-765fd187-4075-424c-a90f-4d1b86dadf0c for instance with task_state deleting. {{(pid=82522) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 11:23:37 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [-] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Instance destroyed successfully.
Apr 17 11:23:38 user nova-compute[82522]: DEBUG nova.objects.instance [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'resources' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=82522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG nova.virt.libvirt.vif [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T11:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1614419249',display_name='tempest-AttachVolumeNegativeTest-server-1614419249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1614419249',id=47,image_ref='66764afd-311a-41a0-a068-b2937b23acba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4qah2EQ3/gXG23uGEJJi0SjaHzeSRjRdYjX7zfo8aLMEzvLdldhA8sGlVvRr0dPEc9Xfo5Hxf2kd/lwfKx9bue55cGB8lLxsLq2PmxzqElILsQT1hzHCO8ZJZmWCbh9A==',key_name='tempest-keypair-968594398',keypairs=<?>,launch_index=0,launched_at=2023-04-17T11:20:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64eccc3b86914e4ab735b79c4b53a142',ramdisk_id='',reservation_id='r-0k0x4xuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66764afd-311a-41a0-a068-b2937b23acba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-60160992',owner_user_name='tempest-AttachVolumeNegativeTest-60160992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T11:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fc272a75798487d84beedfa65775423',uuid=0dcc9a9e-af00-4f79-add0-f4034f649818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converting VIF {"id": "765fd187-4075-424c-a90f-4d1b86dadf0c", "address": "fa:16:3e:1b:78:e0", "network": {"id": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-306682568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64eccc3b86914e4ab735b79c4b53a142", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765fd187-40", "ovs_interfaceid": "765fd187-4075-424c-a90f-4d1b86dadf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG nova.network.os_vif_util [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:78:e0,bridge_name='br-int',has_traffic_filtering=True,id=765fd187-4075-424c-a90f-4d1b86dadf0c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765fd187-40') {{(pid=82522) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG os_vif [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:78:e0,bridge_name='br-int',has_traffic_filtering=True,id=765fd187-4075-424c-a90f-4d1b86dadf0c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765fd187-40') {{(pid=82522) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap765fd187-40, bridge=br-int, if_exists=True) {{(pid=82522) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:23:38 user nova-compute[82522]: INFO os_vif [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:78:e0,bridge_name='br-int',has_traffic_filtering=True,id=765fd187-4075-424c-a90f-4d1b86dadf0c,network=Network(7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765fd187-40')
Apr 17 11:23:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Deleting instance files /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818_del
Apr 17 11:23:38 user nova-compute[82522]: INFO nova.virt.libvirt.driver [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Deletion of /opt/stack/data/nova/instances/0dcc9a9e-af00-4f79-add0-f4034f649818_del complete
Apr 17 11:23:38 user nova-compute[82522]: INFO nova.compute.manager [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 17 11:23:38 user nova-compute[82522]: DEBUG oslo.service.loopingcall [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82522) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG nova.compute.manager [-] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Deallocating network for instance {{(pid=82522) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 11:23:38 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] deallocate_for_instance() {{(pid=82522) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG nova.network.neutron [-] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Updating instance_info_cache with network_info: [] {{(pid=82522) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 11:23:39 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Took 0.73 seconds to deallocate network for instance.
Apr 17 11:23:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:23:39 user nova-compute[82522]: INFO nova.scheduler.client.report [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Deleted allocations for instance 0dcc9a9e-af00-4f79-add0-f4034f649818
Apr 17 11:23:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.937s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received event network-vif-plugged-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] Acquiring lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] Lock "0dcc9a9e-af00-4f79-add0-f4034f649818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:23:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] No waiting events found dispatching network-vif-plugged-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 11:23:39 user nova-compute[82522]: WARNING nova.compute.manager [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received unexpected event network-vif-plugged-765fd187-4075-424c-a90f-4d1b86dadf0c for instance with vm_state deleted and task_state None.
Apr 17 11:23:39 user nova-compute[82522]: DEBUG nova.compute.manager [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Received event network-vif-deleted-765fd187-4075-424c-a90f-4d1b86dadf0c {{(pid=82522) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 11:23:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:23:53 user nova-compute[82522]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681730618.2366922, 0dcc9a9e-af00-4f79-add0-f4034f649818 => Stopped> {{(pid=82522) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 11:23:53 user nova-compute[82522]: INFO nova.compute.manager [-] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] VM Stopped (Lifecycle Event)
Apr 17 11:23:53 user nova-compute[82522]: DEBUG nova.compute.manager [None req-03ed1600-4439-42cc-8dbd-caa2e32c4e84 None None] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Checking state {{(pid=82522) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 11:23:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:23:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:23:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:23:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:23:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:23:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:23:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:23:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:23:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8940MB free_disk=26.309123992919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:23:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:23:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:24:00 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:24:02 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:24:03 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:24:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:24:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:24:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 11:24:03 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:24:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:24:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:24:10 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:24:10 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:24:11 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:24:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:24:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:24:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:24:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:24:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:24:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:24:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:24:41 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:24:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:24:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:24:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:24:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:24:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:24:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:24:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:24:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:24:56 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:24:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:24:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:24:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=26.30750274658203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:24:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:24:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:00 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:02 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:03 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:25:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:25:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 11:25:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:25:05 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:25:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:25:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:25:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:25:08 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:25:12 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:12 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82522) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 11:25:13 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:13 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:25:17 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:18 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:25:23 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:25:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:28 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:33 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:38 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:25:43 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:47 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:47 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82522) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 11:25:48 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 11:25:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82522) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 11:25:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:25:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82522) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 11:25:53 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Auditing locally available compute resources for user (node: user) {{(pid=82522) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 11:25:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:25:57 user nova-compute[82522]: WARNING nova.virt.libvirt.driver [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 11:25:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Hypervisor/Node resource view: name=user free_ram=9068MB free_disk=26.297569274902344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82522) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82522) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG nova.compute.provider_tree [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed in ProviderTree for provider: 152e783c-5f4a-4c29-a7c0-63b63ff61fda {{(pid=82522) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG nova.scheduler.client.report [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Inventory has not changed for provider 152e783c-5f4a-4c29-a7c0-63b63ff61fda based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82522) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG nova.compute.resource_tracker [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Compute_service record updated for user:user {{(pid=82522) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 11:25:57 user nova-compute[82522]: DEBUG oslo_concurrency.lockutils [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=82522) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 11:25:58 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 11:25:59 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:26:02 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:26:03 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:26:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Starting heal instance info cache {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 11:26:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Rebuilding the list of instances to heal {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 11:26:03 user nova-compute[82522]: DEBUG nova.compute.manager [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Didn't find any instances for network info cache update. {{(pid=82522) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 11:26:03 user nova-compute[82522]: DEBUG oslo_service.periodic_task [None req-95c82655-d2e3-48ba-87c9-61c28fc90180 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82522) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 11:26:03 user nova-compute[82522]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82522) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}